Sep 03 13:25:30 devstack cinder-volume[76083]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 13:25:30 devstack cinder-volume[76083]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 13:25:30 devstack cinder-volume[76083]: we strongly recommend against using it for new projects. Sep 03 13:25:30 devstack cinder-volume[76083]: If you are already using Eventlet, we recommend migrating to a different Sep 03 13:25:30 devstack cinder-volume[76083]: framework. For more detail see Sep 03 13:25:30 devstack cinder-volume[76083]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 13:25:30 devstack cinder-volume[76083]: import eventlet # noqa Sep 03 13:25:34 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:25:34 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:25:34 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:25:34 devstack cinder-volume[76083]: INFO dbcounter [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Registered counter for database cinder Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writer thread running {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:25:35 devstack cinder-volume[76083]: INFO cinder.rpc [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 13:25:35 devstack cinder-volume[76083]: INFO cinder.rpc [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:25:35 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Determined volume DB was empty at startup. Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG cinder.volume.manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 13:25:35 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 13:25:35 devstack cinder-volume[76083]: WARNING stevedore.named [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 13:25:35 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:25:35 devstack cinder-volume[76083]: WARNING cinder.keymgr.conf_key_mgr [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG cinder.volume.drivers.lvm [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:35 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] CMD "cinder-rtstool verify" returned: 0 in 0.401s {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:25:36 devstack cinder-volume[76083]: INFO cinder.rpc [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 13:25:36 devstack cinder-volume[76083]: INFO cinder.rpc [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 13:25:36 devstack cinder-volume[76083]: WARNING stevedore.named [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 13:25:36 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:25:36 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:25:36 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Starting 1 workers Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Started child 76248 {{(pid=76083) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Full set of CONF: {{(pid=76083) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Configuration options gathered from: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] ================================================================================ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] allow_availability_zone_fallback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] allow_compression_on_image_upload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] allowed_direct_url_schemes = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] api_rate_limit = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76248]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] auth_strategy = keystone {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] az_cache_duration = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_host = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_stats_polling_interval = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backup_api_class = cinder.backup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backup_name_template = backup-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backup_use_same_host = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backup_use_temp_snapshot = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] chap_username = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_internal_tenant_project_id = aab812fbabeb47f1942efaa552357ef4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_internal_tenant_user_id = 3f3a532ed58f4f46a9fc04ac08ea1fff {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cloned_volume_same_az = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cluster = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] compression_format = gzip {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] compute_api_class = cinder.compute.nova.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] config_dir = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] config_source = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] control_exchange = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] debug = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] default_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] default_group_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] default_volume_type = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_ssl_cert_verify = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] driver_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] enable_force_upload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] enable_new_services = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] enable_unsupported_driver = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_api_insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_api_ssl_compression = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_ca_certificates_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_catalog_info = image:glance:publicURL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_num_retries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance_request_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] graceful_shutdown_timeout = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] group_api_class = cinder.group.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] host = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_compress_on_upload = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_conversion_address_space_limit = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_conversion_cpu_limit = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_conversion_disable = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_volume_cache_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_volume_cache_max_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] init_host_max_objects_retrieval = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] instance_format = [instance: %(uuid)s] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iscsi_target_flags = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iscsi_write_cache = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iser_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iser_ip_address = 192.168.122.181 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iser_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_color = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_config_append = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_options = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_rotate_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_rotate_interval_type = days {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] log_rotation_type = none {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] max_age = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] max_logfile_count = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] max_logfile_size_mb = 200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] max_over_subscription_ratio = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76248]: INFO cinder.volume.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] message_reap_interval = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] message_ttl = 2592000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] migration_create_volume_timeout_secs = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] monkey_patch = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] monkey_patch_modules = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] my_ip = 192.168.122.181 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] no_snapshot_gb_quota = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] num_iser_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] num_shell_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] num_volume_device_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] nvmeof_conn_info_version = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] nvmet_ns_id = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] nvmet_port_id = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_max_limit = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_ext_list = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_listen_port = 8776 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] osapi_volume_workers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] per_volume_size_limit = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] periodic_fuzzy_delay = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] periodic_interval = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] public_endpoint = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] publish_errors = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_backup_gigabytes = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_backups = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_gigabytes = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_groups = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_snapshots = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] quota_volumes = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] rate_limit_burst = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] rate_limit_except_level = CRITICAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] rate_limit_interval = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] reinit_driver_count = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] report_discard_supported = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] report_interval = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] reservation_clean_interval = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] reservation_expire = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] reserved_image_namespaces = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] reserved_percentage = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] rpc_response_timeout = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] run_external_periodic_tasks = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] scst_target_driver = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_down_time = 720 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] shell_completion = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] snapshot_name_template = snapshot-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] snapshot_same_host = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] state_path = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] storage_availability_zone = nova {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] storage_protocol = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] syslog_log_facility = LOG_USER {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_helper = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_ip_address = 192.168.122.181 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] target_secondary_ip_addresses = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] transport_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] until_refresh = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_chap_auth = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_default_quota_class = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_journal = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_json = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_stderr = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] use_syslog = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] verify_glance_signatures = enabled {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_api_class = cinder.volume.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_clear_size = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_copy_bps_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_dd_blocksize = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_name_template = volume-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_service_inithost_offload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volume_usage_audit_period = month {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] zoning_mode = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_concurrency.disable_process_locking = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.auth_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.cache = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.include_service_catalog = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.interface = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcache_username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.service_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.backend = dogpile.cache.null {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.backend_argument = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.backend_expiration_time = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.config_prefix = cache.oslo {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.debug_cache_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.enable_retry_client = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.enable_socket_keepalive = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.expiration_time = 600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.hashclient_retry_attempts = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_dead_retry = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_pool_maxsize = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_sasl_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.proxies = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.redis_db = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.redis_server = localhost:6379 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.retry_attempts = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.retry_delay = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.socket_keepalive_count = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.socket_keepalive_idle = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.socket_keepalive_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.socket_timeout = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.tls_allowed_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.tls_cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.tls_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.tls_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.tls_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cache.username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] coordination.backend_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.asyncio_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.asyncio_slave_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.backend = sqlalchemy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.connection_debug = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.connection_parameters = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.connection_recycle_time = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.connection_trace = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.db_inc_retry_interval = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.db_max_retries = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.db_max_retry_interval = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.db_retry_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.max_overflow = 50 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.max_pool_size = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.max_retries = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.mysql_wsrep_sync_wait = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.pool_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.retry_interval = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.slave_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.sqlite_synchronous = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.synchronous_reader = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] database.use_db_reconnect = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_tracing.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.connection_string = messaging:// {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.es_doc_type = notification {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.es_scroll_size = 10000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.es_scroll_time = 2m {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.filter_error_trace = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.hmac_keys = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.socket_timeout = 0.1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.trace_requests = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler.trace_sqlalchemy = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler_jaeger.process_tags = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler_jaeger.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] profiler_otlp.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.enforce_new_defaults = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.policy_default_rule = default {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.policy_file = policy.yaml {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.group = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] privsep_osbrick.user = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.group = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] cinder_sys_admin.user = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.send_service_user_token = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] service_user.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] glance.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.chap_username = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.driver_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.extra_capabilities = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iscsi_target_flags = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iscsi_write_cache = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iser_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iser_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.lvm_share_target = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.lvm_type = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.num_shell_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.report_discard_supported = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.reserved_percentage = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.unique_fqdn_network = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.use_chap_auth = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_clear_size = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_reports.file_event_handler = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_reports.log_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.backend_host = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.chap_username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.extra_capabilities = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iser_helper = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iser_ip_address = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iser_port = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.lvm_share_target = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.lvm_type = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.num_shell_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.report_discard_supported = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.reserved_percentage = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.scst_target_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.storage_protocol = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_helper = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_ip_address = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.use_chap_auth = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_clear_size = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] lvmdriver-1.volumes_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_notifications.driver = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_notifications.retry = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] key_manager.fixed_key = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.barbican_api_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.barbican_endpoint = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.barbican_endpoint_type = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.barbican_region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.number_of_retries = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.retry_delay = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.send_service_user_token = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.verify_ssl = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican.verify_ssl_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.auth_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] barbican_service_user.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.approle_role_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.approle_secret_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.auth_method = approle {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.auth_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.kv_mountpoint = secret {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.kv_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.kv_version = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.root_token_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.ssl_ca_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.token_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.token_role = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:25:36 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 13:25:36 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:36 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:36 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.269s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:25:36 devstack cinder-volume[76248]: INFO cinder.brick.local_dev.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:36 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:36 devstack sudo[76503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:36 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:37 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG cinder.brick.local_dev.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76248) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:37 devstack sudo[76590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:37 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:37 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.543s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:37 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:37 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:38 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:38 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 13:25:38 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:38 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:38 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:38 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:38 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:38 devstack sudo[76925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:38 devstack sudo[76925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:38 devstack sudo[76925]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:38 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:38 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:39 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:39 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:39 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:39 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:39 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:39 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:39 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:39 devstack cinder-volume[76248]: INFO cinder.volume.drivers.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:39 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:39 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:39 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:40 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:40 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:40 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:40 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:40 devstack sudo[77037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:40 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:40 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:40 devstack sudo[77041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:40 devstack sudo[77041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:40 devstack sudo[77041]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:40 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:40 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:40 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:41 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:41 devstack cinder-volume[76248]: INFO cinder.volume.driver [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG cinder.volume.driver [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76248) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_db.sqlalchemy.engines [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76248) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writer thread running {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG cinder.db.api [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Building query based on filter {{(pid=76248) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG cinder.image.image_utils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76248) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 13:25:41 devstack cinder-volume[76248]: INFO cinder.keymgr.migration [None req-1fc0a84b-025e-404b-af4e-d6eace69a695 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:41 devstack sudo[77049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:41 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:41 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:41 devstack sudo[77052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:41 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:41 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:41 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:41 devstack sudo[77055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:41 devstack sudo[77055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:42 devstack sudo[77055]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:42 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:42 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:42 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG cinder.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Notifying Schedulers of capabilities ... {{(pid=76248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:25:42 devstack cinder-volume[76248]: INFO cinder.volume.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Driver initialization completed successfully. Sep 03 13:25:42 devstack cinder-volume[76248]: INFO cinder.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Initiating service 2 cleanup Sep 03 13:25:42 devstack cinder-volume[76248]: INFO cinder.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Service 2 cleanup completed. Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG cinder.service [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Creating RPC server for service cinder-volume {{(pid=76248) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG cinder.service [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76248) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 13:25:42 devstack cinder-volume[76248]: INFO cinder.volume.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:42 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:25:42 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:42 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:42 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:42 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:42 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:43 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:43 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:43 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:43 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:25:43 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:43 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:43 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:43 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:25:43 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:25:43 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:25:43 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Sep 03 13:25:43 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:25:43 devstack cinder-volume[76248]: INFO cinder.volume.manager [None req-d26cf682-7faa-4d0d-ba0e-0dfda64be615 None None] Driver post RPC initialization completed successfully. Sep 03 13:25:46 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:25:53 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:25:53 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:26:37 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:26:37 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:26:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:26:37 devstack sudo[79047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:26:37 devstack sudo[79047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:26:37 devstack sudo[79047]: pam_unix(sudo:session): session closed for user root Sep 03 13:26:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:26:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:26:37 devstack sudo[79050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:26:37 devstack sudo[79050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:26:38 devstack sudo[79050]: pam_unix(sudo:session): session closed for user root Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:26:38 devstack sudo[79053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:26:38 devstack sudo[79053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:26:38 devstack sudo[79053]: pam_unix(sudo:session): session closed for user root Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:26:38 devstack sudo[79057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:26:38 devstack sudo[79057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:26:38 devstack sudo[79057]: pam_unix(sudo:session): session closed for user root Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG cinder.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Notifying Schedulers of capabilities ... {{(pid=76248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread count: 6 {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:26:38 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread info: [<_MainThread(MainThread, started 132929195389056)>, , , , , ] {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:27:37 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:27:37 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:27:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:27:37 devstack sudo[82314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:27:37 devstack sudo[82314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:27:37 devstack sudo[82314]: pam_unix(sudo:session): session closed for user root Sep 03 13:27:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:27:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:27:37 devstack sudo[82318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:27:37 devstack sudo[82318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:27:38 devstack sudo[82318]: pam_unix(sudo:session): session closed for user root Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:27:38 devstack sudo[82321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:27:38 devstack sudo[82321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:27:38 devstack sudo[82321]: pam_unix(sudo:session): session closed for user root Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:27:38 devstack sudo[82342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:27:38 devstack sudo[82342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:27:38 devstack sudo[82342]: pam_unix(sudo:session): session closed for user root Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:27:38 devstack cinder-volume[76248]: DEBUG cinder.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Notifying Schedulers of capabilities ... {{(pid=76248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:27:53 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:28:37 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:28:37 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread count: 6 {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:28:37 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread info: [<_MainThread(MainThread, started 132929195389056)>, , , , , ] {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:29:37 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:29:37 devstack cinder-volume[76248]: DEBUG cinder.volume.drivers.lvm [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Updating volume stats {{(pid=76248) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 13:29:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:29:37 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 13:29:37 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:29:37 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Sep 03 13:29:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:29:37 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:29:37 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:29:37 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:29:38 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:29:38 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 13:29:38 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:29:38 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:29:38 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 13:29:38 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:29:38 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_concurrency.processutils [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG cinder.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Notifying Schedulers of capabilities ... {{(pid=76248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG oslo_service.periodic_task [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread count: 6 {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:29:38 devstack cinder-volume[76248]: DEBUG cinder.volume.manager [None req-a17efa23-761e-417c-8305-de5b20a291b7 None None] thread info: [<_MainThread(MainThread, started 132929195389056)>, , , , , ] {{(pid=76248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:29:53 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writing DB stats cinder:SELECT=1 {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:29:53 devstack cinder-volume[76248]: DEBUG dbcounter [-] [76248] Writing DB stats cinder:UPDATE=1 {{(pid=76248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:29:59 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Caught SIGTERM, stopping children Sep 03 13:29:59 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:29:59 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:29:59 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:29:59 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Stop services. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 13:29:59 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Killing children. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 13:29:59 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Waiting on 1 children to exit Sep 03 13:30:02 devstack cinder-volume[76248]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Acquiring lock "singleton_lock" {{(pid=76248) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:30:02 devstack cinder-volume[76248]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Acquired lock "singleton_lock" {{(pid=76248) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:30:02 devstack cinder-volume[76248]: DEBUG oslo_concurrency.lockutils [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Releasing lock "singleton_lock" {{(pid=76248) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:30:02 devstack cinder-volume[76248]: WARNING amqp [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 13:30:02 devstack cinder-volume[76248]: WARNING amqp [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 13:30:02 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-d682cc71-eed4-43ff-a593-4f772e843e3b None None] Child 76248 exited with status 0 Sep 03 13:30:02 devstack cinder-volume[86229]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 13:30:02 devstack cinder-volume[86229]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 13:30:02 devstack cinder-volume[86229]: we strongly recommend against using it for new projects. Sep 03 13:30:02 devstack cinder-volume[86229]: If you are already using Eventlet, we recommend migrating to a different Sep 03 13:30:02 devstack cinder-volume[86229]: framework. For more detail see Sep 03 13:30:02 devstack cinder-volume[86229]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 13:30:02 devstack cinder-volume[86229]: import eventlet # noqa Sep 03 13:30:04 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:30:04 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:30:04 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:30:05 devstack cinder-volume[86229]: INFO dbcounter [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Registered counter for database cinder Sep 03 13:30:05 devstack cinder-volume[86229]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:05 devstack cinder-volume[86229]: DEBUG dbcounter [-] [86229] Writer thread running {{(pid=86229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:30:05 devstack cinder-volume[86229]: INFO cinder.rpc [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 13:30:05 devstack cinder-volume[86229]: INFO cinder.rpc [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 13:30:05 devstack cinder-volume[86229]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:06 devstack cinder-volume[86229]: INFO cinder.volume.manager [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Determined volume DB was empty at startup. Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG cinder.volume.manager [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86229) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 13:30:06 devstack cinder-volume[86229]: INFO cinder.volume.manager [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 13:30:06 devstack cinder-volume[86229]: WARNING stevedore.named [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 13:30:06 devstack cinder-volume[86229]: WARNING castellan.key_manager [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:30:06 devstack cinder-volume[86229]: WARNING cinder.keymgr.conf_key_mgr [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:30:06 devstack cinder-volume[86229]: INFO cinder.volume.manager [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:06 devstack cinder-volume[86229]: INFO oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Starting 1 workers Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Started child 86444 {{(pid=86229) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Full set of CONF: {{(pid=86229) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] ******************************************************************************** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Configuration options gathered from: {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] ================================================================================ {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] allow_availability_zone_fallback = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] allow_compression_on_image_upload = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] allowed_direct_url_schemes = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] api_rate_limit = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] auth_strategy = keystone {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_availability_zone = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_host = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_stats_polling_interval = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backup_api_class = cinder.backup.api.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backup_name_template = backup-%s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backup_use_same_host = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backup_use_temp_snapshot = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] chap_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] chap_username = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_internal_tenant_project_id = aab812fbabeb47f1942efaa552357ef4 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_internal_tenant_user_id = 3f3a532ed58f4f46a9fc04ac08ea1fff {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cluster = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] compression_format = gzip {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] config_dir = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] config_source = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] control_exchange = openstack {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] debug = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] default_availability_zone = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] default_group_type = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] default_volume_type = QuobyteHD {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] disk_geometry = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_client_cert = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_client_cert_key = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_data_namespace = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86444]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_ssl_cert_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_ssl_cert_verify = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] driver_use_ssl = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] enable_new_services = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] enable_unsupported_driver = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] enforce_multipath_for_image_xfer = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] filter_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_api_insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_api_ssl_compression = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_ca_certificates_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_num_retries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance_request_timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] goodness_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] graceful_shutdown_timeout = 5 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] group_api_class = cinder.group.api.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] host = devstack {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_compress_on_upload = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_conversion_address_space_limit = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_conversion_cpu_limit = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_conversion_disable = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_upload_use_cinder_backend = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_upload_use_internal_tenant = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_volume_cache_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_volume_cache_max_count = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] init_host_max_objects_retrieval = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] instance_format = [instance: %(uuid)s] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iscsi_target_flags = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iscsi_write_cache = on {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iser_helper = tgtadm {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iser_ip_address = 192.168.122.181 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iser_port = 3260 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_color = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_config_append = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_dir = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_options = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_rotate_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_rotate_interval_type = days {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] log_rotation_type = none {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] max_age = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] max_logfile_count = 30 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] max_logfile_size_mb = 200 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] max_over_subscription_ratio = 20.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] message_reap_interval = 86400 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] message_ttl = 2592000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] monkey_patch = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] monkey_patch_modules = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] my_ip = 192.168.122.181 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] no_snapshot_gb_quota = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] num_iser_scan_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] num_shell_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] num_volume_device_scan_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] nvmeof_conn_info_version = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] nvmet_ns_id = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] nvmet_port_id = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_max_limit = 1000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_ext_list = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_listen_port = 8776 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_use_ssl = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] osapi_volume_workers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] per_volume_size_limit = -1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] periodic_fuzzy_delay = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] periodic_interval = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] public_endpoint = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] publish_errors = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_backup_gigabytes = 1000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_backups = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_gigabytes = 1000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_groups = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_snapshots = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] quota_volumes = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] rate_limit_burst = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] rate_limit_except_level = CRITICAL {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] rate_limit_interval = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] reinit_driver_count = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] replication_device = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] report_discard_supported = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] report_interval = 120 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] reservation_clean_interval = 86400 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.remotefs [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86444) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] reservation_expire = 86400 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] reserved_image_namespaces = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] reserved_percentage = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] rpc_response_timeout = 120 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] run_external_periodic_tasks = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] scst_target_driver = iscsi {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] scst_target_iqn_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_down_time = 720 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] shell_completion = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] snapshot_name_template = snapshot-%s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] split_loggers = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] state_path = /opt/stack/data/cinder {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] storage_availability_zone = nova {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] storage_protocol = iSCSI {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] syslog_log_facility = LOG_USER {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_helper = lioadm {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_ip_address = 192.168.122.181 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_port = 3260 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_protocol = iscsi {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] target_secondary_ip_addresses = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] trace_flags = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] transport_url = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] until_refresh = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_chap_auth = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_default_quota_class = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_journal = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_json = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_multipath_for_image_xfer = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_stderr = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] use_syslog = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] verify_glance_signatures = enabled {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_api_class = cinder.volume.api.API {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_backend_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_clear = zero {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_clear_ionice = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_clear_size = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_copy_bps_limit = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_dd_blocksize = 1M {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_name_template = volume-%s {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_service_inithost_offload = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volume_usage_audit_period = month {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] zoning_mode = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.auth_section = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.auth_type = password {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.auth_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.cache = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.interface = public {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcache_username = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.region_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.service_type = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.backend = dogpile.cache.null {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.backend_argument = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.backend_expiration_time = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.config_prefix = cache.oslo {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.debug_cache_backend = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.enable_retry_client = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.enable_socket_keepalive = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.expiration_time = 600 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_dead_retry = 300 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_sasl_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.proxies = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.redis_db = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.redis_server = localhost:6379 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.retry_attempts = 2 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.retry_delay = 0.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.socket_keepalive_count = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.socket_keepalive_idle = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.socket_keepalive_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.socket_timeout = 1.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.tls_allowed_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.tls_cafile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.tls_certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.tls_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.tls_keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cache.username = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] coordination.backend_url = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.asyncio_connection = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.asyncio_slave_connection = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.backend = sqlalchemy {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.connection = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.connection_debug = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.connection_parameters = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.connection_recycle_time = 3600 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.connection_trace = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.db_inc_retry_interval = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.db_max_retries = 20 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.db_max_retry_interval = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.db_retry_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.max_overflow = 50 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.max_pool_size = 5 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.max_retries = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.pool_timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.retry_interval = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.slave_connection = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.sqlite_synchronous = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.synchronous_reader = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] database.use_db_reconnect = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_tracing.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86444) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 13:30:06 devstack cinder-volume[86444]: WARNING cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 13:30:06 devstack cinder-volume[86444]: WARNING cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.connection_string = messaging:// {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.es_doc_type = notification {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.es_scroll_size = 10000 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.es_scroll_time = 2m {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.filter_error_trace = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Running cmd (subprocess): mount.quobyte {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.hmac_keys = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.sentinel_service_name = mymaster {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.socket_timeout = 0.1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.trace_requests = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler.trace_sqlalchemy = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler_jaeger.process_tags = {} {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] profiler_otlp.service_name_prefix = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.policy_default_rule = default {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.group = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.helper_command = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] privsep_osbrick.user = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.group = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.helper_command = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] cinder_sys_admin.user = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.auth_section = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.auth_type = password {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.cafile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.collect_timing = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.send_service_user_token = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.split_loggers = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.tls_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] service_user.tls_min_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.auth_section = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.auth_type = password {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.collect_timing = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.region_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.split_loggers = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.tls_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] glance.tls_min_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.backend_availability_zone = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.chap_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.chap_username = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.disk_geometry = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_client_cert = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_data_namespace = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.driver_use_ssl = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.extra_capabilities = {} {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.filter_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.goodness_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iscsi_target_flags = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iser_port = 3260 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_host = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_login = admin {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_mount_options = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_private_key = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_share_path = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.replication_device = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.report_discard_supported = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_helper = tgtadm {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_port = 3260 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_protocol = iscsi {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.trace_flags = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.use_chap_auth = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_backend_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_clear = zero {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_reports.file_event_handler = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_reports.log_dir = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.backend_host = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.chap_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.chap_username = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.disk_geometry = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_client_cert = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.extra_capabilities = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.filter_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.goodness_function = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iser_helper = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iser_ip_address = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iser_port = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_host = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_login = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_mount_options = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_password = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_private_key = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_share_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.num_shell_tries = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.replication_device = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.report_discard_supported = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.reserved_percentage = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.scst_target_driver = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.storage_protocol = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_helper = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_ip_address = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_port = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_prefix = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_protocol = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.trace_flags = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.use_chap_auth = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_clear = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_clear_size = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] QuobyteHD.volumes_dir = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack quobyte-client[86445]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack quobyte-client[86445]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86444]: INFO cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c ... Sep 03 13:30:06 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e -c /etc/quobyte/client-cinder.cfg {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_notifications.driver = [] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] key_manager.fixed_key = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.barbican_api_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.barbican_endpoint = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.barbican_endpoint_type = public {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.barbican_region_name = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.cafile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.collect_timing = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.number_of_retries = 60 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.retry_delay = 1 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.send_service_user_token = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.split_loggers = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.tls_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.tls_min_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.verify_ssl = True {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican.verify_ssl_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.auth_section = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.auth_type = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.cafile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.certfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.collect_timing = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.insecure = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.keyfile = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.split_loggers = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.timeout = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.tls_ciphers = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] barbican_service_user.tls_min_version = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.approle_role_id = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.approle_secret_id = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.auth_method = approle {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.auth_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.kv_mountpoint = secret {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.kv_path = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.kv_version = 2 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.namespace = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.root_token_id = **** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.ssl_ca_crt_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.timeout = 60.0 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.token_file = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.token_role = None {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.use_ssl = False {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:06 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] ******************************************************************************** {{(pid=86229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 13:30:06 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e -c /etc/quobyte/client-cinder.cfg Sep 03 13:30:06 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:07 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c succeeded Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.436s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:07 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:07 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:07 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.260s {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.volume.driver [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Driver hasn't implemented _init_vendor_properties() Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.volume.driver [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8440437316895, 'free_capacity_gb': 1773.8440437316895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86444) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_db.sqlalchemy.engines [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG dbcounter [-] [86444] Writer thread running {{(pid=86444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.db.api [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Building query based on filter {{(pid=86444) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.image.image_utils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86444) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.keymgr.migration [None req-3267e24a-c92f-4541-bccb-79835e3415e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:07 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:07 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:07 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.265s {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Notifying Schedulers of capabilities ... {{(pid=86444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Driver initialization completed successfully. Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Initiating service 3 cleanup Sep 03 13:30:07 devstack cinder-volume[86444]: INFO cinder.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Service 3 cleanup completed. Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.service [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Creating RPC server for service cinder-volume {{(pid=86444) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 13:30:07 devstack cinder-volume[86444]: DEBUG cinder.service [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86444) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 13:30:08 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG cinder.volume.drivers.quobyte [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:08 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:08 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:08 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:08 devstack cinder-volume[86444]: DEBUG oslo_concurrency.processutils [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.403s {{(pid=86444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:08 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-f3503b33-55d0-47ff-9a3d-050a79c5e32d None None] Driver post RPC initialization completed successfully. Sep 03 13:30:11 devstack cinder-volume[86229]: INFO oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Caught SIGTERM, stopping children Sep 03 13:30:11 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Acquiring lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:30:11 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Acquired lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:30:11 devstack cinder-volume[86229]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Releasing lock "singleton_lock" {{(pid=86229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:30:11 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Stop services. {{(pid=86229) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 13:30:11 devstack cinder-volume[86229]: DEBUG oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Killing children. {{(pid=86229) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 13:30:11 devstack cinder-volume[86229]: INFO oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Waiting on 1 children to exit Sep 03 13:30:12 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Acquiring lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:30:12 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Acquired lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:30:12 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Releasing lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:30:12 devstack cinder-volume[86444]: WARNING amqp [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 13:30:12 devstack cinder-volume[86444]: WARNING amqp [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 13:30:12 devstack cinder-volume[86229]: INFO oslo_service.backend._eventlet.service [None req-1ac7c043-39bd-4b18-b1f8-1776c06e35f4 None None] Child 86444 exited with status 0 Sep 03 13:30:12 devstack cinder-volume[86716]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 13:30:12 devstack cinder-volume[86716]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 13:30:12 devstack cinder-volume[86716]: we strongly recommend against using it for new projects. Sep 03 13:30:12 devstack cinder-volume[86716]: If you are already using Eventlet, we recommend migrating to a different Sep 03 13:30:12 devstack cinder-volume[86716]: framework. For more detail see Sep 03 13:30:12 devstack cinder-volume[86716]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 13:30:12 devstack cinder-volume[86716]: import eventlet # noqa Sep 03 13:30:15 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 13:30:15 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 13:30:15 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 13:30:15 devstack cinder-volume[86716]: INFO dbcounter [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Registered counter for database cinder Sep 03 13:30:15 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:16 devstack cinder-volume[86716]: DEBUG dbcounter [-] [86716] Writer thread running {{(pid=86716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:30:16 devstack cinder-volume[86716]: INFO cinder.rpc [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 13:30:16 devstack cinder-volume[86716]: INFO cinder.rpc [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 13:30:16 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:16 devstack cinder-volume[86716]: INFO cinder.volume.manager [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Determined volume DB was empty at startup. Sep 03 13:30:16 devstack cinder-volume[86716]: DEBUG cinder.volume.manager [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86716) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 13:30:16 devstack cinder-volume[86716]: WARNING stevedore.named [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 13:30:16 devstack cinder-volume[86716]: WARNING castellan.key_manager [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:30:16 devstack cinder-volume[86716]: WARNING cinder.keymgr.conf_key_mgr [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 13:30:16 devstack cinder-volume[86716]: INFO cinder.volume.manager [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 13:30:16 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:17 devstack cinder-volume[86716]: INFO oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Starting 1 workers Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Started child 86933 {{(pid=86716) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Full set of CONF: {{(pid=86716) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] ******************************************************************************** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] Configuration options gathered from: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] ================================================================================ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] allow_availability_zone_fallback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86933]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] allow_compression_on_image_upload = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] allowed_direct_url_schemes = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] api_rate_limit = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] auth_strategy = keystone {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_stats_polling_interval = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backup_api_class = cinder.backup.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backup_name_template = backup-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backup_use_same_host = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backup_use_temp_snapshot = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] chap_username = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_internal_tenant_project_id = aab812fbabeb47f1942efaa552357ef4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_internal_tenant_user_id = 3f3a532ed58f4f46a9fc04ac08ea1fff {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cluster = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] compression_format = gzip {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] compute_api_class = cinder.compute.nova.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] config_dir = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] config_source = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] control_exchange = openstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] debug = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] default_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] default_group_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] default_volume_type = QuobyteHD {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_ssl_cert_verify = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] driver_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] enable_new_services = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] enable_unsupported_driver = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] enabled_backends = ['QuobyteHD'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] enforce_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_api_insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_api_ssl_compression = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_ca_certificates_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_catalog_info = image:glance:publicURL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_num_retries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance_request_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] graceful_shutdown_timeout = 5 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] group_api_class = cinder.group.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] host = devstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_compress_on_upload = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_conversion_address_space_limit = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_conversion_cpu_limit = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_conversion_disable = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_upload_use_cinder_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_upload_use_internal_tenant = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_volume_cache_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_volume_cache_max_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] image_volume_cache_max_size_gb = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] init_host_max_objects_retrieval = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] instance_format = [instance: %(uuid)s] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iscsi_target_flags = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iscsi_write_cache = on {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iser_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iser_ip_address = 192.168.122.181 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iser_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_color = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_config_append = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_options = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_rotate_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_rotate_interval_type = days {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] log_rotation_type = none {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] max_age = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] max_logfile_count = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] max_logfile_size_mb = 200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] max_over_subscription_ratio = 20.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] message_reap_interval = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86933) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] message_ttl = 2592000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] migration_create_volume_timeout_secs = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] monkey_patch = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] monkey_patch_modules = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] my_ip = 192.168.122.181 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] no_snapshot_gb_quota = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] num_iser_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] num_shell_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] num_volume_device_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] nvmeof_conn_info_version = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] nvmet_ns_id = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] nvmet_port_id = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_max_limit = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_ext_list = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_listen_port = 8776 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] osapi_volume_workers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] per_volume_size_limit = -1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] periodic_fuzzy_delay = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] periodic_interval = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] public_endpoint = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] publish_errors = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_backup_gigabytes = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_backups = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_gigabytes = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_groups = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_snapshots = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] quota_volumes = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86933) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 13:30:17 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 13:30:17 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] rate_limit_burst = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] rate_limit_except_level = CRITICAL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] rate_limit_interval = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] reinit_driver_count = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] report_discard_supported = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] report_interval = 120 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] reservation_clean_interval = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] reservation_expire = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] reserved_image_namespaces = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] reserved_percentage = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] rpc_response_timeout = 120 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] run_external_periodic_tasks = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] scst_target_driver = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_down_time = 720 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] shell_completion = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] snapshot_name_template = snapshot-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] state_path = /opt/stack/data/cinder {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] storage_availability_zone = nova {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] storage_protocol = iSCSI {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] syslog_log_facility = LOG_USER {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_helper = lioadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_ip_address = 192.168.122.181 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_protocol = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] target_secondary_ip_addresses = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] transport_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] until_refresh = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_chap_auth = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_default_quota_class = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_journal = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_json = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_stderr = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] use_syslog = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] verify_glance_signatures = enabled {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_api_class = cinder.volume.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_clear = zero {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_clear_size = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_copy_bps_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_dd_blocksize = 1M {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_name_template = volume-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_service_inithost_offload = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volume_usage_audit_period = month {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] zoning_mode = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_concurrency.disable_process_locking = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack quobyte-client[86960]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 13:30:17 devstack quobyte-client[86960]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.auth_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.include_service_catalog = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.interface = public {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcache_username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.service_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.backend = dogpile.cache.null {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.backend_argument = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.backend_expiration_time = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.config_prefix = cache.oslo {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.debug_cache_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.enable_retry_client = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.enable_socket_keepalive = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.expiration_time = 600 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.hashclient_retry_attempts = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_dead_retry = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_pool_maxsize = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_sasl_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.proxies = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.redis_db = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.redis_server = localhost:6379 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.retry_attempts = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.retry_delay = 0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.socket_keepalive_count = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.socket_keepalive_idle = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.socket_keepalive_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.socket_timeout = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.tls_allowed_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.tls_cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.tls_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.tls_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.tls_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cache.username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] coordination.backend_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.asyncio_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.asyncio_slave_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.backend = sqlalchemy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.connection_debug = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.connection_parameters = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.connection_recycle_time = 3600 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.connection_trace = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.db_inc_retry_interval = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.db_max_retries = 20 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.db_max_retry_interval = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.db_retry_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.max_overflow = 50 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.max_pool_size = 5 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.max_retries = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:17 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.mysql_wsrep_sync_wait = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.pool_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.retry_interval = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.slave_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.sqlite_synchronous = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.synchronous_reader = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] database.use_db_reconnect = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_tracing.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.connection_string = messaging:// {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.es_doc_type = notification {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.es_scroll_size = 10000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.es_scroll_time = 2m {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.filter_error_trace = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.hmac_keys = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.sentinel_service_name = mymaster {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.socket_timeout = 0.1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.trace_requests = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler.trace_sqlalchemy = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler_jaeger.process_tags = {} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler_jaeger.service_name_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] profiler_otlp.service_name_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.enforce_new_defaults = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.policy_default_rule = default {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.policy_file = policy.yaml {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.group = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.helper_command = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] privsep_osbrick.user = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.group = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.helper_command = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] cinder_sys_admin.user = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.send_service_user_token = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] service_user.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] glance.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.chap_username = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.driver_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.extra_capabilities = {} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iscsi_target_flags = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iscsi_write_cache = on {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iser_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iser_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_host = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_login = admin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_mount_options = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_private_key = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_share_path = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.num_shell_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.quobyte_volume_url = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.report_discard_supported = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.reserved_percentage = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_protocol = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.unique_fqdn_network = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.use_chap_auth = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_clear = zero {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_clear_size = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_reports.file_event_handler = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_reports.log_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.backend_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.chap_username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.chiscsi_conf = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.driver_use_ssl = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.extra_capabilities = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iser_helper = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iser_ip_address = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iser_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.iser_target_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_login = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_mount_options = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_private_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_share_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_ssh_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.num_shell_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.nvmet_port_id = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.report_discard_supported = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.reserved_percentage = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.scst_target_driver = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.storage_protocol = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_helper = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_ip_address = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_protocol = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.use_chap_auth = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_clear = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_clear_size = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] QuobyteHD.volumes_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_notifications.driver = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_notifications.retry = -1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] key_manager.fixed_key = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.barbican_api_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.barbican_endpoint = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.barbican_endpoint_type = public {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.barbican_region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.number_of_retries = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.retry_delay = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.send_service_user_token = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.verify_ssl = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican.verify_ssl_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.auth_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] barbican_service_user.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.approle_role_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.approle_secret_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.auth_method = approle {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.auth_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.kv_mountpoint = secret {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.kv_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.kv_version = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.root_token_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.ssl_ca_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.token_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.token_role = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 13:30:17 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-16f40a87-847c-4372-8451-b2015b5da083 None None] ******************************************************************************** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 13:30:17 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:17 devstack cinder-volume[86933]: INFO cinder.volume.driver [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.driver [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8440437316895, 'free_capacity_gb': 1773.8440437316895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86933) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_db.sqlalchemy.engines [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86933) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writer thread running {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.db.api [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Building query based on filter {{(pid=86933) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86933) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:17 devstack cinder-volume[86933]: INFO cinder.keymgr.migration [None req-755d3046-a919-4e06-af85-83d880583d5e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 13:30:17 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:17 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:18 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:30:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Driver initialization completed successfully. Sep 03 13:30:18 devstack cinder-volume[86933]: INFO cinder.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Initiating service 3 cleanup Sep 03 13:30:18 devstack cinder-volume[86933]: INFO cinder.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Service 3 cleanup completed. Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG cinder.service [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Creating RPC server for service cinder-volume {{(pid=86933) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG cinder.service [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86933) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 13:30:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:30:18 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:30:18 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:30:18 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Sep 03 13:30:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:30:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4327ec3d-6176-40da-bc10-e8d8ce98e9c5 None None] Driver post RPC initialization completed successfully. Sep 03 13:30:27 devstack cinder-volume[86716]: DEBUG dbcounter [-] [86716] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:30:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:30:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=3 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:30:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:30:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 6 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:30:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Flow 'volume_create_manager' (aed0c5e5-9ce0-42f7-a05a-d4964662bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62ce3c-c0e5-460a-b888-f03d07193fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62ce3c-c0e5-460a-b888-f03d07193fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1084862671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1321510-5d48-48b5-8a06-392f10677f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb52b8399b134fea94b309bac652d532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:18Z,use_quota=True,user_id='efbebdb36f1c4ddc9ca2df18ce7680e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac396b1-5432-4a9b-a30a-8d4bb3e64855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac396b1-5432-4a9b-a30a-8d4bb3e64855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9299f944-70de-4b7c-ac3b-883d868d1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9299f944-70de-4b7c-ac3b-883d868d1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1321510-5d48-48b5-8a06-392f10677f90', 'volume_name': 'volume-c1321510-5d48-48b5-8a06-392f10677f90', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26736ff-4ae5-4f2c-b32e-b9cc1d293ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26736ff-4ae5-4f2c-b32e-b9cc1d293ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5848553-6c51-4fc7-a69b-03cefd712684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:18 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Volume c1321510-5d48-48b5-8a06-392f10677f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1321510-5d48-48b5-8a06-392f10677f90', 'volume_size': 1} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1084862671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1321510-5d48-48b5-8a06-392f10677f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb52b8399b134fea94b309bac652d532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:18Z,use_quota=True,user_id='efbebdb36f1c4ddc9ca2df18ce7680e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Creating volume c1321510-5d48-48b5-8a06-392f10677f90 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:31:18 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:31:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:18 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 1073741824 Sep 03 13:31:18 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:19 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 1073741824" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:19 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 Sep 03 13:31:19 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:19 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5848553-6c51-4fc7-a69b-03cefd712684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1321510-5d48-48b5-8a06-392f10677f90', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06452c0-ca93-4f85-8e8b-4fa0dd3c1f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:19 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Volume volume-c1321510-5d48-48b5-8a06-392f10677f90 (c1321510-5d48-48b5-8a06-392f10677f90): created successfully Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06452c0-ca93-4f85-8e8b-4fa0dd3c1f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Flow 'volume_create_manager' (aed0c5e5-9ce0-42f7-a05a-d4964662bff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b4fdd261-219d-4250-9e7d-61775982511c tempest-TaggedAttachmentsTest-819341280 None] Created volume successfully. Sep 03 13:31:29 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:31:29 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Flow 'volume_create_manager' (c4858256-5e1d-42e7-83dd-f0a49937ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e4485-cce5-48b6-baa6-5045fe84e7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e4485-cce5-48b6-baa6-5045fe84e7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-435756865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a4b4ec-cc4a-4d9e-ba27-7af9202731b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc4ad21d38d4ee19eecc13b0b2d4e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:30Z,use_quota=True,user_id='e62b13b5957b4b55aae64dfc1042e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6756add4-e46f-4022-b202-99cc4ddbf19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6756add4-e46f-4022-b202-99cc4ddbf19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538bc757-f6b0-4583-ab5c-f92698184a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538bc757-f6b0-4583-ab5c-f92698184a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a4b4ec-cc4a-4d9e-ba27-7af9202731b7', 'volume_name': 'volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8374e7b6-17a8-412c-be9e-1730fae5f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8374e7b6-17a8-412c-be9e-1730fae5f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0473c009-54fe-4b9b-8e16-00450e106cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Volume 09a4b4ec-cc4a-4d9e-ba27-7af9202731b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7', 'volume_size': 1} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-435756865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a4b4ec-cc4a-4d9e-ba27-7af9202731b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc4ad21d38d4ee19eecc13b0b2d4e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:30Z,use_quota=True,user_id='e62b13b5957b4b55aae64dfc1042e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Creating volume 09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:31:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:31:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:30 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 1073741824 Sep 03 13:31:30 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:31 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 1073741824" returned: 0 in 1.185s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:31 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 Sep 03 13:31:31 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:32 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" returned: 0 in 0.416s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0473c009-54fe-4b9b-8e16-00450e106cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe8c3c-86a9-4afe-9cc4-4de888a9f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:32 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Volume volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 (09a4b4ec-cc4a-4d9e-ba27-7af9202731b7): created successfully Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe8c3c-86a9-4afe-9cc4-4de888a9f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Flow 'volume_create_manager' (c4858256-5e1d-42e7-83dd-f0a49937ab15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4826fc3d-83bd-4f7f-a349-b95cdd057a2c tempest-DeleteServersTestJSON-1606699146 None] Created volume successfully. Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:33 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:31:33 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:34 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.786s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:31:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:31:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 6 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:31:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:31:38 devstack cinder-volume[86933]: WARNING py.warnings [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 03 13:31:38 devstack cinder-volume[86933]: .first() Sep 03 13:31:38 devstack cinder-volume[86933]: Sep 03 13:31:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f079dc6-59f9-4cae-b893-16d46ee0acff', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:31:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-4dd8bfaf-578f-471a-ab69-88415d020cb5 req-129d1e33-943e-4bb7-8480-564b2c066354 tempest-DeleteServersTestJSON-1606699146 None] attachment_update completed successfully. Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Flow 'volume_create_manager' (db678e34-3d3b-4c19-a7e9-84a32e25f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bef192-923e-42e0-835e-ad9f351f9130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bef192-923e-42e0-835e-ad9f351f9130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-253728940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fa1a29-40d5-4655-b81c-a44223f128a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65046c9c563d40188ce67b630167ba9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:45Z,use_quota=True,user_id='6dd2163080904635b00157d16952eeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000d2a1b-4fb4-4086-99ab-ec25bcce10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000d2a1b-4fb4-4086-99ab-ec25bcce10d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab176f25-0ec0-4e78-83c0-0ec061a1bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab176f25-0ec0-4e78-83c0-0ec061a1bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fa1a29-40d5-4655-b81c-a44223f128a9', 'volume_name': 'volume-27fa1a29-40d5-4655-b81c-a44223f128a9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45470b2b-d35e-4912-8e54-b7b44e119919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45470b2b-d35e-4912-8e54-b7b44e119919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792f5272-89dd-4cb4-a3d4-066908f00d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Volume 27fa1a29-40d5-4655-b81c-a44223f128a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fa1a29-40d5-4655-b81c-a44223f128a9', 'volume_size': 1} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-253728940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fa1a29-40d5-4655-b81c-a44223f128a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65046c9c563d40188ce67b630167ba9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:31:45Z,use_quota=True,user_id='6dd2163080904635b00157d16952eeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Creating volume 27fa1a29-40d5-4655-b81c-a44223f128a9 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:31:44 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:31:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:44 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 1073741824 Sep 03 13:31:44 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:45 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 1073741824" returned: 0 in 0.870s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:45 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 Sep 03 13:31:45 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:46 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9" returned: 0 in 0.763s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792f5272-89dd-4cb4-a3d4-066908f00d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fa1a29-40d5-4655-b81c-a44223f128a9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f001de-9c9b-4adf-b15b-1a6e41a0ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:31:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Volume volume-27fa1a29-40d5-4655-b81c-a44223f128a9 (27fa1a29-40d5-4655-b81c-a44223f128a9): created successfully Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f001de-9c9b-4adf-b15b-1a6e41a0ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:31:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Flow 'volume_create_manager' (db678e34-3d3b-4c19-a7e9-84a32e25f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:31:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4390590e-337f-4160-9c75-1e56b1fcf211 tempest-VolumesAdminNegativeTest-1789144780 None] Created volume successfully. Sep 03 13:31:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-589c334c-04b1-476f-b457-25823890a408 req-0ba82fa2-37e9-4b19-9193-2e0a03f473bf tempest-DeleteServersTestJSON-1606699146 None] Terminate volume connection completed successfully. Sep 03 13:31:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-589c334c-04b1-476f-b457-25823890a408 req-0ba82fa2-37e9-4b19-9193-2e0a03f473bf tempest-DeleteServersTestJSON-1606699146 None] Deleting attachment 1f079dc6-59f9-4cae-b893-16d46ee0acff. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:31:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Acquiring lock "cinder-27fa1a29-40d5-4655-b81c-a44223f128a9-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:31:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "cinder-27fa1a29-40d5-4655-b81c-a44223f128a9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:31:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Acquiring lock "cinder-quobyte-27fa1a29-40d5-4655-b81c-a44223f128a9" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:31:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "cinder-quobyte-27fa1a29-40d5-4655-b81c-a44223f128a9" acquired by "delete_volume" :: waited 0.050s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:31:48 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpifvgz5e8/privsep.sock'] Sep 03 13:31:48 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpifvgz5e8/privsep.sock Sep 03 13:31:48 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 13:31:50 devstack cinder-volume[86933]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 13:31:50 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "cinder-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:31:50 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Spawned new privsep daemon via rootwrap Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Accepted privsep connection to /tmp/tmpifvgz5e8/privsep.sock {{(pid=86933) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 13:31:50 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 13:31:50 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 13:31:50 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 13:31:50 devstack cinder-volume[86933]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88696 Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53f2119-82fd-4ffa-87c0-d2975ab2c2ae]: (2,) {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "cinder-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c316de9b-e96d-42eb-a611-7b87bcc336a9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:31:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "cinder-quobyte-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "cinder-quobyte-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" acquired by "delete_volume" :: waited 0.058s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e989316-7b85-49b2-bdda-903e39ddd0a3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:51 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 Sep 03 13:31:51 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:51 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 Sep 03 13:31:51 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:51 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9" returned: 0 in 1.027s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:51 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" returned: 0 in 0.742s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:51 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9 Sep 03 13:31:51 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:52 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7 Sep 03 13:31:52 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:52 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-27fa1a29-40d5-4655-b81c-a44223f128a9" returned: 0 in 0.620s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "cinder-quobyte-27fa1a29-40d5-4655-b81c-a44223f128a9" released by "delete_volume" :: held 3.892s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:31:52 devstack cinder-volume[86933]: WARNING cinder.quota [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:31:52 devstack cinder-volume[86933]: WARNING cinder.quota [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:31:52 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" returned: 0 in 0.727s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "cinder-quobyte-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7" released by "delete_volume" :: held 1.625s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Created reservations ['2a188cb2-db0c-4e19-afb4-bb2b808e5615', '46e69ae7-25f2-465d-b8f9-fd35d31935b8', 'fc7c169e-2bd4-4a0d-9cbc-31f36c1ad5c1', '461251cf-0c12-4b58-bb2e-b9bbccb05bc0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:31:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Created reservations ['ad6ad654-34d4-4131-b4c0-227b3144e999', '63c85387-54ef-4def-9064-320bed8fb097', 'a37fffbd-132c-47d9-baea-a1d8c3d7dee5', '28499902-ce2b-4e74-b4d8-963c84ec2a3c'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:53 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:31:53 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:31:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:31:53 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:31:53 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:31:54 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.898s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:31:54 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Sep 03 13:31:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Deleted volume successfully. Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.808s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:31:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Deleted volume successfully. Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c8339408-9ddf-4710-b6e3-e25bb7e5eb4c tempest-VolumesAdminNegativeTest-1789144780 None] Lock "cinder-27fa1a29-40d5-4655-b81c-a44223f128a9-delete_volume" released by "delete_volume" :: held 5.567s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:31:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6812d809-c1af-4e3d-9991-f2a9083b0937 tempest-DeleteServersTestJSON-1606699146 None] Lock "cinder-09a4b4ec-cc4a-4d9e-ba27-7af9202731b7-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:03 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=18,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:04 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=25,cinder:SELECT=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7a045be8-237c-4c42-889e-7c24ddfda845 tempest-GroupSnapshotsV319Test-791342944 None] Group tempest-GroupSnapshotsV319Test-Group-51490033: creating Sep 03 13:32:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7a045be8-237c-4c42-889e-7c24ddfda845 tempest-GroupSnapshotsV319Test-791342944 None] Group tempest-GroupSnapshotsV319Test-Group-51490033: created successfully Sep 03 13:32:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7a045be8-237c-4c42-889e-7c24ddfda845 tempest-GroupSnapshotsV319Test-791342944 None] Create group completed successfully. Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Flow 'volume_create_manager' (b2ac85e2-1187-49a3-90a4-b968cd9ef50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811d33b-2d31-4af7-a816-9f4b086c653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811d33b-2d31-4af7-a816-9f4b086c653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822843655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5de57ff3-b144-4272-bef1-22381598ad90,host='devstack@QuobyteHD#QuobyteHD',id=cabf4b58-cd94-4748-9049-15a6110f1041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96a2df4f2d74636824470670654f5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:07Z,use_quota=True,user_id='51867b929afd4a86b2a453445c538a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7dc4f5-d68b-4c18-aa30-b99b79be7c81),volume_type_id=db7dc4f5-d68b-4c18-aa30-b99b79be7c81)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad2ffee-7df0-467a-b103-763ab73da919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad2ffee-7df0-467a-b103-763ab73da919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f119656-c483-459c-b6a9-9ff97968b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f119656-c483-459c-b6a9-9ff97968b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabf4b58-cd94-4748-9049-15a6110f1041', 'volume_name': 'volume-cabf4b58-cd94-4748-9049-15a6110f1041', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3527c535-a5cc-4bcd-ae9a-1e17c867b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3527c535-a5cc-4bcd-ae9a-1e17c867b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c18470d-b25b-4547-8dd3-cf028ab4e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:07 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Volume cabf4b58-cd94-4748-9049-15a6110f1041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabf4b58-cd94-4748-9049-15a6110f1041', 'volume_size': 1} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5de57ff3-b144-4272-bef1-22381598ad90,created_at=2026-09-03T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822843655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5de57ff3-b144-4272-bef1-22381598ad90,host='devstack@QuobyteHD#QuobyteHD',id=cabf4b58-cd94-4748-9049-15a6110f1041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96a2df4f2d74636824470670654f5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:07Z,use_quota=True,user_id='51867b929afd4a86b2a453445c538a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7dc4f5-d68b-4c18-aa30-b99b79be7c81),volume_type_id=db7dc4f5-d68b-4c18-aa30-b99b79be7c81)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Creating volume cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:32:07 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:07 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 1073741824 Sep 03 13:32:07 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:07 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 1073741824" returned: 0 in 0.515s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:07 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 Sep 03 13:32:07 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:08 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c18470d-b25b-4547-8dd3-cf028ab4e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabf4b58-cd94-4748-9049-15a6110f1041', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a559e5-b34d-4235-9a51-d21be2d5c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:08 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Volume volume-cabf4b58-cd94-4748-9049-15a6110f1041 (cabf4b58-cd94-4748-9049-15a6110f1041): created successfully Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a559e5-b34d-4235-9a51-d21be2d5c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Flow 'volume_create_manager' (b2ac85e2-1187-49a3-90a4-b968cd9ef50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b97578ee-7006-4ec2-95c3-716634880e2f tempest-GroupSnapshotsV319Test-791342944 None] Created volume successfully. Sep 03 13:32:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] GroupSnapshot 77b925b1-b07e-4330-b40b-04653edbe466: creating. Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Group snapshot 77b925b1-b07e-4330-b40b-04653edbe466: creating. {{(pid=86933) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Creating offline snapshot c973e99a-2cc9-4fbb-b191-1410a9cacbb0 of volume cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab8f402-8287-43f9-beca-dc8568c2017b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:32:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:08 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 Sep 03 13:32:08 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:09 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041" returned: 0 in 0.389s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:09 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 1G Sep 03 13:32:09 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:09 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 1G" returned: 0 in 0.511s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf4b58-cd94-4748-9049-15a6110f1041 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:09 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf4b58-cd94-4748-9049-15a6110f1041 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 Sep 03 13:32:09 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:10 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf4b58-cd94-4748-9049-15a6110f1041 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0" returned: 0 in 0.490s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:10 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:10 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 Sep 03 13:32:10 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:10 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0" returned: 0 in 0.301s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:10 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info Sep 03 13:32:10 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:10 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info" returned: 0 in 0.326s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:10 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:32:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:10 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info Sep 03 13:32:10 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:11 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.info" returned: 0 in 0.311s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-82faafa7-8285-4140-b986-cee824ed5110 tempest-GroupSnapshotsV319Test-791342944 None] group_snapshot 77b925b1-b07e-4330-b40b-04653edbe466: created successfully Sep 03 13:32:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] group_snapshot 77b925b1-b07e-4330-b40b-04653edbe466: deleting Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] group_snapshot 77b925b1-b07e-4330-b40b-04653edbe466: deleting {{(pid=86933) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "cinder-quobyte-c973e99a-2cc9-4fbb-b191-1410a9cacbb0" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-c973e99a-2cc9-4fbb-b191-1410a9cacbb0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Deleting offline snapshot c973e99a-2cc9-4fbb-b191-1410a9cacbb0 of volume cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] snapshot_file for this snap is: volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc82cbea-a8df-491d-aafe-a45218521eb0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:32:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:13 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 Sep 03 13:32:13 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:13 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cabf4b58-cd94-4748-9049-15a6110f1041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c2d4d-ffa5-4c84-ac0e-46af593f4f03]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:13 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 Sep 03 13:32:13 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:13 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041" returned: 0 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:13 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 Sep 03 13:32:13 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:14 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0" returned: 0 in 0.572s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:14 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0 Sep 03 13:32:14 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:14 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041.c973e99a-2cc9-4fbb-b191-1410a9cacbb0" returned: 0 in 0.322s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-c973e99a-2cc9-4fbb-b191-1410a9cacbb0" released by "_delete_snapshot" :: held 1.926s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" released by "delete_snapshot" :: held 1.960s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:14 devstack cinder-volume[86933]: WARNING cinder.quota [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-872718670 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-872718670, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:32:14 devstack cinder-volume[86933]: WARNING cinder.quota [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-872718670 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-872718670, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:32:14 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] Created reservations ['e7fdebd4-606e-40e2-9d39-f3b2e3fb384a', 'a40d49c4-4d20-4ca4-9894-a07abd243101', 'df8e6a21-2635-42fa-a847-18329d083224', '1e1d61cd-5219-4910-b3bc-a0dbe9716674'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:32:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0db4e48b-1fa8-4c15-bc7d-76cf6f10a70e tempest-GroupSnapshotsV319Test-791342944 None] group_snapshot 77b925b1-b07e-4330-b40b-04653edbe466: deleted successfully Sep 03 13:32:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:32:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:32:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701ce80-cb21-44c1-a125-45f144c7ef94]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:32:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:16 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 Sep 03 13:32:16 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:16 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041" returned: 0 in 0.486s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:16 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041 Sep 03 13:32:16 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:16 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cabf4b58-cd94-4748-9049-15a6110f1041" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Lock "cinder-quobyte-cabf4b58-cd94-4748-9049-15a6110f1041" released by "delete_volume" :: held 0.939s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Created reservations ['ac828d39-044a-40bf-ab08-3f95cbe59e93'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:32:16 devstack cinder-volume[86933]: WARNING cinder.quota [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-872718670 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-872718670, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:32:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Created reservations ['f514b85d-7eb9-44a8-b801-9410ca7da72c', 'f7dc3ed9-9e08-4b24-8d53-431e1cab90b1', 'e9c63c71-f551-4de8-9ab2-8ee70ff22da0', 'd4ed4147-f31b-42f0-acb8-eae441a5fbc0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:17 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:32:17 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:17 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:32:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-12ade993-729f-486c-a159-5f42af5aff41 tempest-GroupSnapshotsV319Test-791342944 None] Delete group completed successfully. Sep 03 13:32:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1309f397-0dbe-4ac8-9bbf-be6887506291 req-d05d08c6-602a-4f63-92f7-c822ea1ec199 tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1309f397-0dbe-4ac8-9bbf-be6887506291 req-d05d08c6-602a-4f63-92f7-c822ea1ec199 tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1309f397-0dbe-4ac8-9bbf-be6887506291 req-d05d08c6-602a-4f63-92f7-c822ea1ec199 tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-1309f397-0dbe-4ac8-9bbf-be6887506291 req-d05d08c6-602a-4f63-92f7-c822ea1ec199 tempest-TaggedAttachmentsTest-819341280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-c1321510-5d48-48b5-8a06-392f10677f90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fa9ca08-6ada-4523-9bde-248fba8f8e70', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:32:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-1309f397-0dbe-4ac8-9bbf-be6887506291 req-d05d08c6-602a-4f63-92f7-c822ea1ec199 tempest-TaggedAttachmentsTest-819341280 None] attachment_update completed successfully. Sep 03 13:32:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-9305b20c-241b-4299-884f-e3526f36e769 req-fe1c64fa-3da8-4d3a-b3ca-f7ad51db01f9 tempest-TaggedAttachmentsTest-819341280 None] Terminate volume connection completed successfully. Sep 03 13:32:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-9305b20c-241b-4299-884f-e3526f36e769 req-fe1c64fa-3da8-4d3a-b3ca-f7ad51db01f9 tempest-TaggedAttachmentsTest-819341280 None] Deleting attachment 5fa9ca08-6ada-4523-9bde-248fba8f8e70. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:33 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:32:33 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:33 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:32:34 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=24,cinder:SELECT=34,cinder:INSERT=4 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:39 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "cinder-c1321510-5d48-48b5-8a06-392f10677f90-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "cinder-c1321510-5d48-48b5-8a06-392f10677f90-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "cinder-quobyte-c1321510-5d48-48b5-8a06-392f10677f90" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "cinder-quobyte-c1321510-5d48-48b5-8a06-392f10677f90" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd75bb-f521-4608-8a34-a9ec515e7705]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:32:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:44 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 Sep 03 13:32:44 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:45 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90" returned: 0 in 0.457s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:45 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90 Sep 03 13:32:45 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:45 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c1321510-5d48-48b5-8a06-392f10677f90" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "cinder-quobyte-c1321510-5d48-48b5-8a06-392f10677f90" released by "delete_volume" :: held 0.808s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Created reservations ['da35d6c0-423d-48d7-9780-2f40488d37a2', '8561aa7a-7592-4cf9-ae30-dbc6a1327e55', 'd52aa418-d8ae-4dc2-992c-94cbad45f0bf', 'e9983343-2ab0-4c5c-9695-4a3759f0386f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:45 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:32:45 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:46 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.336s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:46 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:32:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Deleted volume successfully. Sep 03 13:32:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e4323d9c-4094-47c8-aa7d-6eda37204c81 tempest-TaggedAttachmentsTest-819341280 None] Lock "cinder-c1321510-5d48-48b5-8a06-392f10677f90-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:32:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=3 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:56 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Flow 'volume_create_manager' (256f65d1-0a43-4d01-83ac-96c8efe09b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa3032c-b593-4a36-ab39-36894507959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa3032c-b593-4a36-ab39-36894507959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1865315777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c056304a-9570-4b25-b47d-d7c14f0ae169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9683ec8c09a496593d5f9c91d13fde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:57Z,use_quota=True,user_id='c450c17fd4984964bf365c02199d9e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41de82c5-b80a-4b7f-b489-2d208491572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41de82c5-b80a-4b7f-b489-2d208491572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91e122f-1334-41d8-a03c-65faa7b9cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91e122f-1334-41d8-a03c-65faa7b9cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c056304a-9570-4b25-b47d-d7c14f0ae169', 'volume_name': 'volume-c056304a-9570-4b25-b47d-d7c14f0ae169', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8936893-1845-4d09-b5bb-ea2c3f119652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8936893-1845-4d09-b5bb-ea2c3f119652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bd7d44-d2ad-4caf-83bd-d98186e9b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Volume c056304a-9570-4b25-b47d-d7c14f0ae169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c056304a-9570-4b25-b47d-d7c14f0ae169', 'volume_size': 1} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1865315777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c056304a-9570-4b25-b47d-d7c14f0ae169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9683ec8c09a496593d5f9c91d13fde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:57Z,use_quota=True,user_id='c450c17fd4984964bf365c02199d9e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Creating volume c056304a-9570-4b25-b47d-d7c14f0ae169 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:32:57 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:57 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 1073741824 Sep 03 13:32:57 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Flow 'volume_create_manager' (0cdde488-e230-4de5-9fe8-aae17470977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18280f53-a0b3-47b2-b573-c50aec6d8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18280f53-a0b3-47b2-b573-c50aec6d8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1519797896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b9043-e8d8-4def-b601-9303f27c87ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e80df0f354bc29286e1f9fc8b2dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:57Z,use_quota=True,user_id='10f764f579b04ac4a2352c1e6cde1d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3f2307-b92a-47b7-9426-8d37fa8da376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3f2307-b92a-47b7-9426-8d37fa8da376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8129adf-ccb4-4f7a-8d6e-78fb1c47de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8129adf-ccb4-4f7a-8d6e-78fb1c47de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070b9043-e8d8-4def-b601-9303f27c87ce', 'volume_name': 'volume-070b9043-e8d8-4def-b601-9303f27c87ce', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3411794e-6914-4b9e-a9ef-e78a2227d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3411794e-6914-4b9e-a9ef-e78a2227d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bac713-3991-47ae-bf68-1773fc0eac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Volume 070b9043-e8d8-4def-b601-9303f27c87ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070b9043-e8d8-4def-b601-9303f27c87ce', 'volume_size': 1} Sep 03 13:32:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:58 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 1073741824" returned: 0 in 0.769s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:58 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 Sep 03 13:32:58 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:58 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169" returned: 0 in 0.345s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1519797896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b9043-e8d8-4def-b601-9303f27c87ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e80df0f354bc29286e1f9fc8b2dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:32:57Z,use_quota=True,user_id='10f764f579b04ac4a2352c1e6cde1d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Creating volume 070b9043-e8d8-4def-b601-9303f27c87ce {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:32:58 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:58 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce 1073741824 Sep 03 13:32:58 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bd7d44-d2ad-4caf-83bd-d98186e9b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c056304a-9570-4b25-b47d-d7c14f0ae169', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1273b1ec-7991-4adb-8976-3286467b0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Volume volume-c056304a-9570-4b25-b47d-d7c14f0ae169 (c056304a-9570-4b25-b47d-d7c14f0ae169): created successfully Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1273b1ec-7991-4adb-8976-3286467b0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Flow 'volume_create_manager' (256f65d1-0a43-4d01-83ac-96c8efe09b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4f04c275-36d1-4f51-9f25-730fea8604cf tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Created volume successfully. Sep 03 13:32:59 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce 1073741824" returned: 0 in 0.677s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:32:59 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce Sep 03 13:32:59 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:32:59 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce" returned: 0 in 0.378s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bac713-3991-47ae-bf68-1773fc0eac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070b9043-e8d8-4def-b601-9303f27c87ce', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78160f7a-7710-4ed8-8f92-e4616f22e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:32:59 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Volume volume-070b9043-e8d8-4def-b601-9303f27c87ce (070b9043-e8d8-4def-b601-9303f27c87ce): created successfully Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78160f7a-7710-4ed8-8f92-e4616f22e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:32:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Flow 'volume_create_manager' (0cdde488-e230-4de5-9fe8-aae17470977b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:32:59 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cb35b768-b3d4-427a-9fdf-e48a30f3ff0e tempest-ServerActionsTestOtherA-518335211 None] Created volume successfully. Sep 03 13:33:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Acquiring lock "cinder-c056304a-9570-4b25-b47d-d7c14f0ae169-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:33:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "cinder-c056304a-9570-4b25-b47d-d7c14f0ae169-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Acquiring lock "cinder-quobyte-c056304a-9570-4b25-b47d-d7c14f0ae169" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "cinder-quobyte-c056304a-9570-4b25-b47d-d7c14f0ae169" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370d88e-2a32-4ae9-9fb3-ecdb687b804e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:01 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 Sep 03 13:33:01 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:01 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169" returned: 0 in 0.616s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:01 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169 Sep 03 13:33:01 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:02 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c056304a-9570-4b25-b47d-d7c14f0ae169" returned: 0 in 0.484s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "cinder-quobyte-c056304a-9570-4b25-b47d-d7c14f0ae169" released by "delete_volume" :: held 1.156s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Created reservations ['31241fbf-1b9b-4dd1-9e14-f0710dc16fe6', 'cbcc3174-0d72-404f-b0fe-847855815b11', 'a1591ab0-5e69-49d1-af76-95f109b64938', 'e52a4516-dd65-4389-a3f9-178b33165dc3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:02 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:33:02 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:02 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:33:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Deleted volume successfully. Sep 03 13:33:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fce62763-9ba7-4ef1-a470-cb80a1dcf5e0 tempest-VolumeQuotasNegativeTestJSON-2117942647 None] Lock "cinder-c056304a-9570-4b25-b47d-d7c14f0ae169-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Flow 'volume_create_manager' (c55bc8aa-408c-4c11-8d22-e50005484c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab2b231-2cae-4c81-a303-4ba573ede266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab2b231-2cae-4c81-a303-4ba573ede266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-953804423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a587557b-9e7b-4db0-aeab-90c0742d1ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bafd25c8b734ce5a6570e2417e4674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:12Z,use_quota=True,user_id='aa060b74969c4f12a0e16f5cd8030019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(937c2bc5-966e-4002-80c8-e0d8e9675a3a),volume_type_id=937c2bc5-966e-4002-80c8-e0d8e9675a3a)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64a0bd1-e5b3-4111-b4f4-59875a750acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64a0bd1-e5b3-4111-b4f4-59875a750acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d8b7a1-c95f-4741-a80d-6ba5b4fbdffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d8b7a1-c95f-4741-a80d-6ba5b4fbdffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a587557b-9e7b-4db0-aeab-90c0742d1ef4', 'volume_name': 'volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfaa41f-39e2-4763-9e98-875d9327fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfaa41f-39e2-4763-9e98-875d9327fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fcb786-419d-4d75-be42-0838ac0d627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Volume a587557b-9e7b-4db0-aeab-90c0742d1ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4', 'volume_size': 1} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-953804423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a587557b-9e7b-4db0-aeab-90c0742d1ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bafd25c8b734ce5a6570e2417e4674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:12Z,use_quota=True,user_id='aa060b74969c4f12a0e16f5cd8030019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(937c2bc5-966e-4002-80c8-e0d8e9675a3a),volume_type_id=937c2bc5-966e-4002-80c8-e0d8e9675a3a)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Creating volume a587557b-9e7b-4db0-aeab-90c0742d1ef4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:33:12 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:33:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:12 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 1073741824 Sep 03 13:33:12 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:13 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 1073741824" returned: 0 in 0.765s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:13 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 Sep 03 13:33:13 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:14 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4" returned: 0 in 0.494s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fcb786-419d-4d75-be42-0838ac0d627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1882f4-a060-45f1-8023-2fad81844dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Volume volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 (a587557b-9e7b-4db0-aeab-90c0742d1ef4): created successfully Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1882f4-a060-45f1-8023-2fad81844dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Flow 'volume_create_manager' (c55bc8aa-408c-4c11-8d22-e50005484c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5173ac36-fd2e-4576-a79e-122240ee6608 tempest-VolumeTypesAccessTest-1054255952 None] Created volume successfully. Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Acquiring lock "cinder-a587557b-9e7b-4db0-aeab-90c0742d1ef4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "cinder-a587557b-9e7b-4db0-aeab-90c0742d1ef4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Acquiring lock "cinder-quobyte-a587557b-9e7b-4db0-aeab-90c0742d1ef4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "cinder-quobyte-a587557b-9e7b-4db0-aeab-90c0742d1ef4" acquired by "delete_volume" :: waited 0.049s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c7c1b-37bd-455c-bf8a-0f840a43e23a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:33:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:15 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 Sep 03 13:33:15 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:15 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4" returned: 0 in 0.456s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:15 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4 Sep 03 13:33:15 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:15 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a587557b-9e7b-4db0-aeab-90c0742d1ef4" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "cinder-quobyte-a587557b-9e7b-4db0-aeab-90c0742d1ef4" released by "delete_volume" :: held 0.872s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:33:15 devstack cinder-volume[86933]: WARNING cinder.quota [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-507400758 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-507400758, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:33:15 devstack cinder-volume[86933]: WARNING cinder.quota [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-507400758 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-507400758, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:33:15 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Created reservations ['8c5f3ad6-ad55-4c0b-883f-62422e32a76d', 'f68a234d-fb76-4443-bb60-bdba364a78a8', '19d2a22b-8de6-452a-9085-baa53d661f95', '2872eba3-1972-4dbe-935f-ad676a41a7c2'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:16 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:33:16 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:16 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:33:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Deleted volume successfully. Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8cc7ac41-0554-46c6-bde9-0f796fd87bed tempest-VolumeTypesAccessTest-1054255952 None] Lock "cinder-a587557b-9e7b-4db0-aeab-90c0742d1ef4-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Flow 'volume_create_manager' (4fa78160-90b1-4822-9720-809cff096a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096bd99a-48e2-456d-b8fa-b95248f60352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096bd99a-48e2-456d-b8fa-b95248f60352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-973180482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f75dca-1b11-4ed0-b6f1-a0d78c936804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9374823c0c4e0d899f4c52c2e1f62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:17Z,use_quota=True,user_id='60bfa352e3a34421befbe681cadb43a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce6d165-6840-441e-ae0c-a4626c798d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce6d165-6840-441e-ae0c-a4626c798d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d68848-b51d-4cf7-b998-147986d9bf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d68848-b51d-4cf7-b998-147986d9bf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f75dca-1b11-4ed0-b6f1-a0d78c936804', 'volume_name': 'volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c2f60f-f41e-4061-9727-273777075659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c2f60f-f41e-4061-9727-273777075659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32546480-2cbd-451d-8076-53d0c6f1dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:16 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Volume 41f75dca-1b11-4ed0-b6f1-a0d78c936804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804', 'volume_size': 1} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-973180482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f75dca-1b11-4ed0-b6f1-a0d78c936804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9374823c0c4e0d899f4c52c2e1f62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:17Z,use_quota=True,user_id='60bfa352e3a34421befbe681cadb43a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Creating volume 41f75dca-1b11-4ed0-b6f1-a0d78c936804 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:33:16 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:33:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:16 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 1073741824 Sep 03 13:33:16 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:17 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 1073741824" returned: 0 in 0.593s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:17 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 Sep 03 13:33:17 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:17 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804" returned: 0 in 0.537s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:33:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32546480-2cbd-451d-8076-53d0c6f1dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee30b13-8ca6-446d-b599-e0354d196eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:18 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Volume volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 (41f75dca-1b11-4ed0-b6f1-a0d78c936804): created successfully Sep 03 13:33:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee30b13-8ca6-446d-b599-e0354d196eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Flow 'volume_create_manager' (4fa78160-90b1-4822-9720-809cff096a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-95b59950-3952-4592-98fd-613908e80101 tempest-AttachVolumeShelveTestJSON-281435435 None] Created volume successfully. Sep 03 13:33:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:33:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=31,cinder:SELECT=17,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:33 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:33:33 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:34 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.605s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:33:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:33:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 8 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:33:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:33:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-376175b8-4651-424e-a845-c8dfb7ea1054 req-d29f6cc5-8aac-44d9-a97b-f30dbbbbbd7c tempest-AttachVolumeShelveTestJSON-281435435 None] No connector for attachment bf368d17-bcd4-4622-b85a-5b136923abf8; skipping storage backend terminate_connection call. {{(pid=86933) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 13:33:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-376175b8-4651-424e-a845-c8dfb7ea1054 req-d29f6cc5-8aac-44d9-a97b-f30dbbbbbd7c tempest-AttachVolumeShelveTestJSON-281435435 None] Deleting attachment bf368d17-bcd4-4622-b85a-5b136923abf8. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:33:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-99560bee-4c9b-402c-ad58-d944e04dea98 req-96be9e82-5543-4641-828d-6cc67360b18e tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-99560bee-4c9b-402c-ad58-d944e04dea98 req-96be9e82-5543-4641-828d-6cc67360b18e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-99560bee-4c9b-402c-ad58-d944e04dea98 req-96be9e82-5543-4641-828d-6cc67360b18e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-99560bee-4c9b-402c-ad58-d944e04dea98 req-96be9e82-5543-4641-828d-6cc67360b18e tempest-ServerActionsTestOtherA-518335211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-070b9043-e8d8-4def-b601-9303f27c87ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72f64def-7718-411b-a02e-56557ecaa107', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:33:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-99560bee-4c9b-402c-ad58-d944e04dea98 req-96be9e82-5543-4641-828d-6cc67360b18e tempest-ServerActionsTestOtherA-518335211 None] attachment_update completed successfully. Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Flow 'volume_create_manager' (e74ca35b-cc08-4de7-829e-7a56693dbc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74f9b8b-fe92-4ff7-b77d-ba225f23df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74f9b8b-fe92-4ff7-b77d-ba225f23df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-188795224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aea420-1365-4c13-8d2f-11cb34becfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a52aa657b4ffab8478449ccdf95ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:48Z,use_quota=True,user_id='d530e9e47ed24b2e82ca0f438d1e29da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fde9e4-e334-485e-bcf4-3595e4092e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fde9e4-e334-485e-bcf4-3595e4092e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8392f8a3-371a-495a-ad73-12848177deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8392f8a3-371a-495a-ad73-12848177deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29aea420-1365-4c13-8d2f-11cb34becfc3', 'volume_name': 'volume-29aea420-1365-4c13-8d2f-11cb34becfc3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973f0db-b940-4ef8-82c9-2473085f9304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973f0db-b940-4ef8-82c9-2473085f9304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fc93dc-8f58-4d81-8008-c7a969263854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Volume 29aea420-1365-4c13-8d2f-11cb34becfc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29aea420-1365-4c13-8d2f-11cb34becfc3', 'volume_size': 1} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-188795224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aea420-1365-4c13-8d2f-11cb34becfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a52aa657b4ffab8478449ccdf95ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:33:48Z,use_quota=True,user_id='d530e9e47ed24b2e82ca0f438d1e29da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Creating volume 29aea420-1365-4c13-8d2f-11cb34becfc3 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:33:48 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:48 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 1073741824 Sep 03 13:33:48 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-9ead413c-d7bd-4e60-ba93-b7878127e6e1 tempest-ServerActionsTestOtherA-518335211 None] Terminate volume connection completed successfully. Sep 03 13:33:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-9ead413c-d7bd-4e60-ba93-b7878127e6e1 tempest-ServerActionsTestOtherA-518335211 None] Deleting attachment 72f64def-7718-411b-a02e-56557ecaa107. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:33:49 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 1073741824" returned: 0 in 0.977s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:33:49 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 Sep 03 13:33:49 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:33:49 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Sep 03 13:33:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3" returned: 0 in 0.474s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:33:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:33:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fc93dc-8f58-4d81-8008-c7a969263854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29aea420-1365-4c13-8d2f-11cb34becfc3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cb9fb1-263d-435b-ae8f-e6c7a5de73b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:33:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Volume volume-29aea420-1365-4c13-8d2f-11cb34becfc3 (29aea420-1365-4c13-8d2f-11cb34becfc3): created successfully Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cb9fb1-263d-435b-ae8f-e6c7a5de73b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Flow 'volume_create_manager' (e74ca35b-cc08-4de7-829e-7a56693dbc31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:33:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cfcd03c5-aaea-4981-9c07-43236cd60f01 tempest-ServerRescueNegativeTestJSON-903456558 None] Created volume successfully. Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-d0d701b9-e5b8-47ee-85cf-685007329ae0 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-d0d701b9-e5b8-47ee-85cf-685007329ae0 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-d0d701b9-e5b8-47ee-85cf-685007329ae0 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:33:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-d0d701b9-e5b8-47ee-85cf-685007329ae0 tempest-ServerActionsTestOtherA-518335211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-070b9043-e8d8-4def-b601-9303f27c87ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '342b256f-e815-44f7-90c2-2db63a0a5ffe', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:33:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-d481a062-c54b-4d9f-98c4-922ef957dcc0 req-d0d701b9-e5b8-47ee-85cf-685007329ae0 tempest-ServerActionsTestOtherA-518335211 None] attachment_update completed successfully. Sep 03 13:34:00 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:34:01 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Acquiring lock "cinder-29aea420-1365-4c13-8d2f-11cb34becfc3-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "cinder-29aea420-1365-4c13-8d2f-11cb34becfc3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Acquiring lock "cinder-quobyte-29aea420-1365-4c13-8d2f-11cb34becfc3" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "cinder-quobyte-29aea420-1365-4c13-8d2f-11cb34becfc3" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0210738-4711-4ef2-a82d-c17c5fab1657]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:15 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 Sep 03 13:34:15 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:15 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3" returned: 0 in 0.949s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:15 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3 Sep 03 13:34:15 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:16 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29aea420-1365-4c13-8d2f-11cb34becfc3" returned: 0 in 0.519s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "cinder-quobyte-29aea420-1365-4c13-8d2f-11cb34becfc3" released by "delete_volume" :: held 1.524s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Created reservations ['0b8e86bf-6ba7-46a8-94b2-283b142bd8ac', '45aef310-9661-4e7c-aa7e-e71ab7dbeca0', 'c5e46b20-22dc-47b4-b5bc-16612a22f887', 'a2a46334-e7cc-4d8a-9c9a-1b3c433c83cd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:16 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:16 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:17 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Deleted volume successfully. Sep 03 13:34:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c4a67130-6fda-43ba-9fe2-85cd12b28956 tempest-ServerRescueNegativeTestJSON-903456558 None] Lock "cinder-29aea420-1365-4c13-8d2f-11cb34becfc3-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:27 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:34:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-6123e819-4ceb-47bb-b37a-ec026f170255 req-7a7bbecb-d91d-41a9-9827-5634088707a5 tempest-ServerActionsTestOtherA-518335211 None] Terminate volume connection completed successfully. Sep 03 13:34:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-6123e819-4ceb-47bb-b37a-ec026f170255 req-7a7bbecb-d91d-41a9-9827-5634088707a5 tempest-ServerActionsTestOtherA-518335211 None] Deleting attachment 342b256f-e815-44f7-90c2-2db63a0a5ffe. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (d555b779-8059-41db-9d8a-a4fb5f22f685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e767124-8c6a-438d-9b0c-4bcb0bc09d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e767124-8c6a-438d-9b0c-4bcb0bc09d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357065701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f428fe9b-02f3-4334-81e1-b3cc16d73f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:30Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d977384-5cf8-4e24-996d-244f7f6c3863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d977384-5cf8-4e24-996d-244f7f6c3863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94b0ee9-5cd2-4de3-9f3f-3a64891496f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94b0ee9-5cd2-4de3-9f3f-3a64891496f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f428fe9b-02f3-4334-81e1-b3cc16d73f8b', 'volume_name': 'volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17d72be-ed67-4dc8-a346-c555b7a0c085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17d72be-ed67-4dc8-a346-c555b7a0c085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff66ef-5683-474f-9cb1-43696d21d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Volume f428fe9b-02f3-4334-81e1-b3cc16d73f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b', 'volume_size': 1} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357065701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f428fe9b-02f3-4334-81e1-b3cc16d73f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:30Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Creating volume f428fe9b-02f3-4334-81e1-b3cc16d73f8b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:30 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b 1073741824 Sep 03 13:34:30 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:30 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b 1073741824" returned: 0 in 0.607s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:30 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b Sep 03 13:34:30 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:31 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff66ef-5683-474f-9cb1-43696d21d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6785a460-c4c9-4614-b2ee-94a4b4daf00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Volume volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b (f428fe9b-02f3-4334-81e1-b3cc16d73f8b): created successfully Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6785a460-c4c9-4614-b2ee-94a4b4daf00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (d555b779-8059-41db-9d8a-a4fb5f22f685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c3074084-e316-44a2-9ca9-9acec935723d tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:34:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42b78080-b027-4fd0-aa9e-3e8f4c8de723 tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" by "attach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42b78080-b027-4fd0-aa9e-3e8f4c8de723 tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" acquired by "attach_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-42b78080-b027-4fd0-aa9e-3e8f4c8de723 tempest-VolumesActionsTest-545246208 None] Attaching volume f428fe9b-02f3-4334-81e1-b3cc16d73f8b to instance d56c8ee3-46a1-4242-9381-b0969aa787be at mountpoint /dev/vdb on host None. Sep 03 13:34:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-42b78080-b027-4fd0-aa9e-3e8f4c8de723 tempest-VolumesActionsTest-545246208 None] Attach volume completed successfully. Sep 03 13:34:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42b78080-b027-4fd0-aa9e-3e8f4c8de723 tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" released by "attach_volume" :: held 0.290s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Terminate volume connection completed successfully. Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" by "detach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Detaching volume f428fe9b-02f3-4334-81e1-b3cc16d73f8b from instance d56c8ee3-46a1-4242-9381-b0969aa787be. Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:33 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:33 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Detach volume completed successfully. Sep 03 13:34:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1fff2bb7-a52e-41b4-84e5-a3524df3f670 tempest-VolumesActionsTest-439197764 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" released by "detach_volume" :: held 0.197s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:34 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.422s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 8 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d4ffbf3f-2095-4b76-9a54-811311eedffd tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" by "detach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d4ffbf3f-2095-4b76-9a54-811311eedffd tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:34 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d4ffbf3f-2095-4b76-9a54-811311eedffd tempest-VolumesActionsTest-545246208 None] Volume detach called, but volume not attached. Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d4ffbf3f-2095-4b76-9a54-811311eedffd tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-quobyte-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "cinder-quobyte-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[046f6dde-a219-48ad-a9d9-4719a05d8a63]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:34 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b Sep 03 13:34:34 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:35 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" returned: 0 in 0.497s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:35 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b Sep 03 13:34:35 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:35 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "cinder-quobyte-f428fe9b-02f3-4334-81e1-b3cc16d73f8b" released by "delete_volume" :: held 0.875s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Created reservations ['943002ed-eaee-4568-8113-1e9f23a6ce8c', '433b8e86-390a-4719-941d-7129d53ea35d', '77843ef0-6c06-4fcb-9d67-74a31d6bed68', '4799152e-e22b-4c2f-8b50-a8edc45d6548'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:35 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:35 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:36 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.440s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Deleted volume successfully. Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-09a77889-5651-4a95-bd15-cc6fcfb0f9d4 tempest-VolumesActionsTest-545246208 None] Lock "cinder-f428fe9b-02f3-4334-81e1-b3cc16d73f8b-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Flow 'volume_create_manager' (75341a6f-a6cf-458c-84f3-0543868e83d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c549e48e-06d2-4f6c-b603-d5b4b38fb8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c549e48e-06d2-4f6c-b603-d5b4b38fb8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1847904842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e80df0f354bc29286e1f9fc8b2dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:37Z,use_quota=True,user_id='10f764f579b04ac4a2352c1e6cde1d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cddf32f-2b35-4dea-a933-7384b4e06c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cddf32f-2b35-4dea-a933-7384b4e06c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d0e1d-8924-4e0d-87e9-4296cd5cca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:36 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d0e1d-8924-4e0d-87e9-4296cd5cca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'volume_name': 'volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e05a857-bb72-487d-967d-5fc2d2292a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e05a857-bb72-487d-967d-5fc2d2292a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8beeaf3-7547-475b-bf96-fb7635ad600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:37 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Trying to clone cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:34:37 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:34:37 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Image download 20.69 MB at 20.69 MB/s Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a410447-fa11-41f8-af35-19e65212c5e7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:38 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD Sep 03 13:34:38 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:38 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 is fetched for user 10f764f579b04ac4a2352c1e6cde1d73. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[317cc3d3-7255-47bc-beab-43319ce447f7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:38 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD Sep 03 13:34:38 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Flow 'volume_create_manager' (a9f0e1a1-e736-45a3-876a-ef6f0e99f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba64d2-decd-4e7b-9152-f87010430c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba64d2-decd-4e7b-9152-f87010430c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1234848756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca8ac0-251f-4809-b8de-107531eac114,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02d880ae9cd494bbe6fef7e1a3392e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:39Z,use_quota=True,user_id='8386759b3c054d27b1855e861b4fc97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb00ac9c-ab62-4a1c-8797-3be0ad2d256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb00ac9c-ab62-4a1c-8797-3be0ad2d256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d70479-056e-4a05-a468-0275be938de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d70479-056e-4a05-a468-0275be938de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ca8ac0-251f-4809-b8de-107531eac114', 'volume_name': 'volume-f3ca8ac0-251f-4809-b8de-107531eac114', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c283b-8ea4-4e99-ba38-3e2d7b976ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c283b-8ea4-4e99-ba38-3e2d7b976ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7fb406-97ac-4d2c-a67f-152a1206bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:38 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Volume f3ca8ac0-251f-4809-b8de-107531eac114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ca8ac0-251f-4809-b8de-107531eac114', 'volume_size': 1} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1234848756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca8ac0-251f-4809-b8de-107531eac114,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02d880ae9cd494bbe6fef7e1a3392e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:39Z,use_quota=True,user_id='8386759b3c054d27b1855e861b4fc97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Creating volume f3ca8ac0-251f-4809-b8de-107531eac114 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:38 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:38 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 1073741824 Sep 03 13:34:38 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:38 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:39 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 1073741824" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:39 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 Sep 03 13:34:39 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (4981b945-7844-4692-8c07-72ca4adab6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28ccac2-9aaa-4aca-a721-b59bff9a9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28ccac2-9aaa-4aca-a721-b59bff9a9294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-340991278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0c082c-150e-4f52-b830-6e66f542054c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:39Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f781f2f-1953-4497-9477-b234a64d37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f781f2f-1953-4497-9477-b234a64d37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e816bc-bf5d-449c-967c-c112033de188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e816bc-bf5d-449c-967c-c112033de188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0c082c-150e-4f52-b830-6e66f542054c', 'volume_name': 'volume-4c0c082c-150e-4f52-b830-6e66f542054c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09896cad-5008-4c5a-a75d-e91d232d2c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09896cad-5008-4c5a-a75d-e91d232d2c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c46efb1-77ec-45da-9d6b-c701db468b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Volume 4c0c082c-150e-4f52-b830-6e66f542054c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0c082c-150e-4f52-b830-6e66f542054c', 'volume_size': 1} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:39 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1847904842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e80df0f354bc29286e1f9fc8b2dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:37Z,use_quota=True,user_id='10f764f579b04ac4a2352c1e6cde1d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Creating volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:39 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7fb406-97ac-4d2c-a67f-152a1206bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ca8ac0-251f-4809-b8de-107531eac114', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1073741824 Sep 03 13:34:39 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7220e3d9-316f-448e-90eb-45a5b2a59900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Volume volume-f3ca8ac0-251f-4809-b8de-107531eac114 (f3ca8ac0-251f-4809-b8de-107531eac114): created successfully Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7220e3d9-316f-448e-90eb-45a5b2a59900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Flow 'volume_create_manager' (a9f0e1a1-e736-45a3-876a-ef6f0e99f847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-0944a427-7d80-40e8-8d00-992af330b51b req-6f7e24c3-2bac-4b66-a4ce-09e9027ea530 tempest-VolumesGetTestJSON-1766182945 None] Created volume successfully. Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Acquiring lock "cinder-f3ca8ac0-251f-4809-b8de-107531eac114-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "cinder-f3ca8ac0-251f-4809-b8de-107531eac114-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Acquiring lock "cinder-quobyte-f3ca8ac0-251f-4809-b8de-107531eac114" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:39 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1073741824" returned: 0 in 0.501s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "cinder-quobyte-f3ca8ac0-251f-4809-b8de-107531eac114" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9183627-90c0-455e-8765-2783c7152d04]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 Sep 03 13:34:40 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 Sep 03 13:34:40 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-340991278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0c082c-150e-4f52-b830-6e66f542054c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:39Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Creating volume 4c0c082c-150e-4f52-b830-6e66f542054c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:40 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c 1073741824 Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Attempting download of 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:34:40 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114" returned: 0 in 0.393s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b090913-51c1-4e5a-9ddc-eb8786a9fc87]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114 Sep 03 13:34:40 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97 Sep 03 13:34:40 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f3ca8ac0-251f-4809-b8de-107531eac114" returned: 0 in 0.294s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "cinder-quobyte-f3ca8ac0-251f-4809-b8de-107531eac114" released by "delete_volume" :: held 0.737s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.quota [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Created reservations ['4a69607c-c26e-4552-856b-8c1d41470755', 'bd79cf10-4264-428f-87d0-5df925e35c53', 'f657cee0-a820-4eae-9476-40a5b5836d9e', '3ffa34e4-4bd2-46fe-b62d-f1823178b4b7'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:40 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c 1073741824" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:40 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c Sep 03 13:34:40 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:40 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:40 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97 Sep 03 13:34:40 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:41 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c" returned: 0 in 0.286s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:41 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:41 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97" returned: 1 in 0.359s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_skskxp97' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.manager [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2280e7-31f7-4c8d-a5dd-7d313186de10]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c46efb1-77ec-45da-9d6b-c701db468b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0c082c-150e-4f52-b830-6e66f542054c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f1e83-96a3-4c57-bf9e-8b09cebed4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Deleted volume successfully. Sep 03 13:34:41 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Volume volume-4c0c082c-150e-4f52-b830-6e66f542054c (4c0c082c-150e-4f52-b830-6e66f542054c): created successfully Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f1e83-96a3-4c57-bf9e-8b09cebed4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (4981b945-7844-4692-8c07-72ca4adab6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-4244a617-b1ac-403b-b1aa-0458d1e218f3 req-1941d5b3-d082-454a-b4dd-5d1f070d218a tempest-VolumesGetTestJSON-1766182945 None] Lock "cinder-f3ca8ac0-251f-4809-b8de-107531eac114-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ffa87591-0405-4204-8d1d-c9ed27a4dfc3 tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:34:41 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD Sep 03 13:34:41 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-4c0c082c-150e-4f52-b830-6e66f542054c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "cinder-4c0c082c-150e-4f52-b830-6e66f542054c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:41 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-quobyte-4c0c082c-150e-4f52-b830-6e66f542054c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-4c0c082c-150e-4f52-b830-6e66f542054c" acquired by "delete_volume" :: waited 0.056s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:41 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 Sep 03 13:34:41 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa981052-b9fa-4255-9d73-49cea9378145]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:41 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c Sep 03 13:34:41 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:42 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c" returned: 0 in 0.494s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:42 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c Sep 03 13:34:42 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:42 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4c0c082c-150e-4f52-b830-6e66f542054c" returned: 0 in 0.560s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-4c0c082c-150e-4f52-b830-6e66f542054c" released by "delete_volume" :: held 1.171s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Created reservations ['462ed182-494f-46ef-8c72-145a96224d37', 'e65975c1-e2f0-4583-9175-edf68d79b2a5', '9d6a6480-759f-4bea-b8cd-433897e3b656', 'd3cf3cba-3a05-4ac6-84e0-42dc96a95387'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:43 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:43 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:43 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.445s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Deleted volume successfully. Sep 03 13:34:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69dd1a1d-8aa7-4c56-860b-94a254ebe026 tempest-VolumesActionsTest-439197764 None] Lock "cinder-4c0c082c-150e-4f52-b830-6e66f542054c-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:44 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" returned: 0 in 2.666s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_znpbkahodevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:34:44 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Converted 112.00 MB image at 41.99 MB/s Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:44 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1G Sep 03 13:34:44 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (c0fbb643-45c3-4edc-9596-83e75a4515d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aeaaa0-2af1-4579-a9a5-fd8868393627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aeaaa0-2af1-4579-a9a5-fd8868393627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887465862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c203da0-3298-417c-8404-94136e0e9ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:45Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96d6684-a632-4e68-91ad-319a1d3b4a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96d6684-a632-4e68-91ad-319a1d3b4a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9350ea3-c91f-44f5-a2c6-0591dc94b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9350ea3-c91f-44f5-a2c6-0591dc94b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c203da0-3298-417c-8404-94136e0e9ff5', 'volume_name': 'volume-3c203da0-3298-417c-8404-94136e0e9ff5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6015006e-afeb-4264-92fa-2a8fa95e2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6015006e-afeb-4264-92fa-2a8fa95e2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb29521-6f25-4e09-b3a2-00fe3bf98e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Volume 3c203da0-3298-417c-8404-94136e0e9ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c203da0-3298-417c-8404-94136e0e9ff5', 'volume_size': 1} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887465862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c203da0-3298-417c-8404-94136e0e9ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:45Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Creating volume 3c203da0-3298-417c-8404-94136e0e9ff5 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:44 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:44 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 1G" returned: 0 in 0.511s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Downloaded image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 for user 10f764f579b04ac4a2352c1e6cde1d73 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Marking volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:34:44 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 1073741824 Sep 03 13:34:44 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Copying metadata from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 to cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Creating volume glance metadata for volume cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 backed by image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8beeaf3-7547-475b-bf96-fb7635ad600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631625fc-bd31-4d7a-8bf7-03001e4abd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Volume volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 (cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84): created successfully Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631625fc-bd31-4d7a-8bf7-03001e4abd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Flow 'volume_create_manager' (75341a6f-a6cf-458c-84f3-0543868e83d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-629409bb-07d7-487d-b78a-bb96b3d38ba2 tempest-ServerActionsTestOtherA-518335211 None] Created volume successfully. Sep 03 13:34:45 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 1073741824" returned: 0 in 0.676s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:45 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 Sep 03 13:34:45 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:45 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb29521-6f25-4e09-b3a2-00fe3bf98e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c203da0-3298-417c-8404-94136e0e9ff5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6a9478-cc39-49b2-b4f8-e967d5b09987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Volume volume-3c203da0-3298-417c-8404-94136e0e9ff5 (3c203da0-3298-417c-8404-94136e0e9ff5): created successfully Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6a9478-cc39-49b2-b4f8-e967d5b09987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (c0fbb643-45c3-4edc-9596-83e75a4515d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3682ebcd-907c-4f8a-905b-fd85bc4e8e1d tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Acquiring lock "cinder-41f75dca-1b11-4ed0-b6f1-a0d78c936804-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "cinder-41f75dca-1b11-4ed0-b6f1-a0d78c936804-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Acquiring lock "cinder-quobyte-41f75dca-1b11-4ed0-b6f1-a0d78c936804" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "cinder-quobyte-41f75dca-1b11-4ed0-b6f1-a0d78c936804" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7eb26f-a074-4958-9484-8b5bff5b65a3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:46 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 Sep 03 13:34:46 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (feba7251-1594-4f5d-8a55-9beb8fd7ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc8708b-6283-4494-a9a2-e7e89d58dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc8708b-6283-4494-a9a2-e7e89d58dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1792769111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4b45a2-29b6-4d67-8883-ac53a819b7f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:47Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327cd7b-bb4d-4bcb-be7a-c19bfecfe8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327cd7b-bb4d-4bcb-be7a-c19bfecfe8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b075db-18e9-41bd-8041-87493ecf06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b075db-18e9-41bd-8041-87493ecf06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4b45a2-29b6-4d67-8883-ac53a819b7f4', 'volume_name': 'volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9467181-e129-4018-8757-9d9b9d4b3702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9467181-e129-4018-8757-9d9b9d4b3702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1087805-0a35-45b7-b6d3-9f5230849af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Volume ab4b45a2-29b6-4d67-8883-ac53a819b7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4', 'volume_size': 1} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1792769111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4b45a2-29b6-4d67-8883-ac53a819b7f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:47Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Creating volume ab4b45a2-29b6-4d67-8883-ac53a819b7f4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:47 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-3c203da0-3298-417c-8404-94136e0e9ff5-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:47 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 1073741824 Sep 03 13:34:47 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "cinder-3c203da0-3298-417c-8404-94136e0e9ff5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:47 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804" returned: 0 in 0.633s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-quobyte-3c203da0-3298-417c-8404-94136e0e9ff5" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:47 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804 Sep 03 13:34:47 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-3c203da0-3298-417c-8404-94136e0e9ff5" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bb6c9-fa7f-4b2b-bc7b-72b88b790473]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 Sep 03 13:34:47 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-41f75dca-1b11-4ed0-b6f1-a0d78c936804" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "cinder-quobyte-41f75dca-1b11-4ed0-b6f1-a0d78c936804" released by "delete_volume" :: held 1.044s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Created reservations ['0dba7492-e6e8-42f7-97f7-4b4d0258a5d9', '556b248e-ff0c-47c2-a1bd-1f5335f69a62', '7ff9a821-48fe-4442-aa67-cc7ba08b07db', '28488e5c-62db-400a-899e-59692b40ebbd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:47 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 1073741824" returned: 0 in 0.630s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:47 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 Sep 03 13:34:47 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5" returned: 0 in 0.520s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:47 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:47 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5 Sep 03 13:34:47 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:47 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:48 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3c203da0-3298-417c-8404-94136e0e9ff5" returned: 0 in 0.317s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:48 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:48 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" returned: 0 in 0.404s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-3c203da0-3298-417c-8404-94136e0e9ff5" released by "delete_volume" :: held 0.908s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Deleted volume successfully. Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1087805-0a35-45b7-b6d3-9f5230849af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cce500-2f0a-4b0a-8b16-58841ae2839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Volume volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 (ab4b45a2-29b6-4d67-8883-ac53a819b7f4): created successfully Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cce500-2f0a-4b0a-8b16-58841ae2839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (feba7251-1594-4f5d-8a55-9beb8fd7ab52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-022756c6-5228-4d71-b827-5c2898cfa9ec tempest-VolumesTestJSON-2141935760 None] Created volume successfully. Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa1ac2e5-7bda-423d-bb74-d4d03bee9264 tempest-AttachVolumeShelveTestJSON-281435435 None] Lock "cinder-41f75dca-1b11-4ed0-b6f1-a0d78c936804-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Created reservations ['469d99e8-ca8d-4999-b292-33ad84f46ee7', '3590d7a0-f234-41ec-9051-b5c7f9b12dac', 'e407eee5-7a84-4b63-857a-418bfd67e5bb', '771c7396-fe5a-4ecf-9fd6-491e2b409d92'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:48 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:48 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:48 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Deleted volume successfully. Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d37d3c67-6e86-47c1-8a44-17fd5d0550d4 req-7278bc0a-074a-4835-b1da-284fd68a8b8e tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d37d3c67-6e86-47c1-8a44-17fd5d0550d4 req-7278bc0a-074a-4835-b1da-284fd68a8b8e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d37d3c67-6e86-47c1-8a44-17fd5d0550d4 req-7278bc0a-074a-4835-b1da-284fd68a8b8e tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8b273df9-64cc-43e7-9969-5bde7a73bcd8 tempest-VolumesActionsTest-439197764 None] Lock "cinder-3c203da0-3298-417c-8404-94136e0e9ff5-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-d37d3c67-6e86-47c1-8a44-17fd5d0550d4 req-7278bc0a-074a-4835-b1da-284fd68a8b8e tempest-ServerActionsTestOtherA-518335211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7cb8f8e-357a-4723-b731-560c006521f0', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:34:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-d37d3c67-6e86-47c1-8a44-17fd5d0550d4 req-7278bc0a-074a-4835-b1da-284fd68a8b8e tempest-ServerActionsTestOtherA-518335211 None] attachment_update completed successfully. Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (3d1552dd-c63b-450e-8ab4-7dcd1db9ccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4b79be-4c62-49ea-8bd5-d8a4e51ef689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4b79be-4c62-49ea-8bd5-d8a4e51ef689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974718637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982ef26-09d2-4539-9290-dc23dcb277a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:50Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef2448a-8a84-4036-bc43-271d66a60ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef2448a-8a84-4036-bc43-271d66a60ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937ac53f-56d3-406e-824a-980f1dcfe8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937ac53f-56d3-406e-824a-980f1dcfe8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e982ef26-09d2-4539-9290-dc23dcb277a4', 'volume_name': 'volume-e982ef26-09d2-4539-9290-dc23dcb277a4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc09e4-fe90-45bd-afa1-b039c3010ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc09e4-fe90-45bd-afa1-b039c3010ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1c7c05-b99a-4ecb-a980-b98bd85bb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Volume e982ef26-09d2-4539-9290-dc23dcb277a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e982ef26-09d2-4539-9290-dc23dcb277a4', 'volume_size': 1} Sep 03 13:34:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974718637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982ef26-09d2-4539-9290-dc23dcb277a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:50Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Creating volume e982ef26-09d2-4539-9290-dc23dcb277a4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:50 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:50 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 1073741824 Sep 03 13:34:50 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (45f43407-f809-4724-8102-87d9d1dc5914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f074827-77bc-4202-b794-440bb106bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f074827-77bc-4202-b794-440bb106bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1168357853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5740dc-675a-4144-abf9-016c39e5e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:50Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d13366-8f42-4039-a8a6-b2a0ec61405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d13366-8f42-4039-a8a6-b2a0ec61405f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d999a1-99f8-4f76-aa21-6063893b9f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d999a1-99f8-4f76-aa21-6063893b9f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5740dc-675a-4144-abf9-016c39e5e39b', 'volume_name': 'volume-1b5740dc-675a-4144-abf9-016c39e5e39b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e12eaa8-9f97-4514-a117-f985eb9c0f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e12eaa8-9f97-4514-a117-f985eb9c0f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d02e5e-31b5-4902-80ab-ecdc8c759493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Volume 1b5740dc-675a-4144-abf9-016c39e5e39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5740dc-675a-4144-abf9-016c39e5e39b', 'volume_size': 1} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:50 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 1073741824" returned: 0 in 0.531s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:50 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 Sep 03 13:34:50 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:50 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4" returned: 0 in 0.300s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1168357853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5740dc-675a-4144-abf9-016c39e5e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:50Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Creating volume 1b5740dc-675a-4144-abf9-016c39e5e39b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:50 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1c7c05-b99a-4ecb-a980-b98bd85bb63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e982ef26-09d2-4539-9290-dc23dcb277a4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f4e44d-597d-4f1b-a1b1-3608ad3c1bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:50 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b 1073741824 Sep 03 13:34:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Volume volume-e982ef26-09d2-4539-9290-dc23dcb277a4 (e982ef26-09d2-4539-9290-dc23dcb277a4): created successfully Sep 03 13:34:50 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f4e44d-597d-4f1b-a1b1-3608ad3c1bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (3d1552dd-c63b-450e-8ab4-7dcd1db9ccb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5d9e95fd-1271-473e-bf0b-6cf4c8fb8c8b tempest-VolumesTestJSON-2141935760 None] Created volume successfully. Sep 03 13:34:51 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b 1073741824" returned: 0 in 0.606s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:51 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b Sep 03 13:34:51 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:51 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b" returned: 0 in 0.436s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d02e5e-31b5-4902-80ab-ecdc8c759493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5740dc-675a-4144-abf9-016c39e5e39b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5dc3c3-c3fe-4bfe-8193-6578bbf8e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:52 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Volume volume-1b5740dc-675a-4144-abf9-016c39e5e39b (1b5740dc-675a-4144-abf9-016c39e5e39b): created successfully Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5dc3c3-c3fe-4bfe-8193-6578bbf8e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (45f43407-f809-4724-8102-87d9d1dc5914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-723c4562-2f78-442b-babd-deae3a1a9666 tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-1b5740dc-675a-4144-abf9-016c39e5e39b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "cinder-1b5740dc-675a-4144-abf9-016c39e5e39b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-quobyte-1b5740dc-675a-4144-abf9-016c39e5e39b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-1b5740dc-675a-4144-abf9-016c39e5e39b" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a89ff-11c8-4c47-bf16-2245ab0f3681]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:52 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b Sep 03 13:34:52 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (ecb7f79e-f980-4b50-b74c-a3a5d15f3f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d581111-7494-4a0d-9f12-48f3f5a880f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d581111-7494-4a0d-9f12-48f3f5a880f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-552977079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c3a694-0f89-4edb-8dcc-5d14bef1d370,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:53Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e1fecf-8003-4369-b8dd-0418bc909bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e1fecf-8003-4369-b8dd-0418bc909bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab390420-87aa-4c86-9565-ba424861b641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab390420-87aa-4c86-9565-ba424861b641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c3a694-0f89-4edb-8dcc-5d14bef1d370', 'volume_name': 'volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10453c2-63d7-4253-a5f0-53b388c6249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10453c2-63d7-4253-a5f0-53b388c6249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890d9982-f41f-4461-8dc8-f0ccd0a282c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:53 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Volume d7c3a694-0f89-4edb-8dcc-5d14bef1d370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370', 'volume_size': 1} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-552977079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c3a694-0f89-4edb-8dcc-5d14bef1d370,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e35113d58e46f189856f80473f0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:53Z,use_quota=True,user_id='b284433fd07d4d1fbdef02dd6a8423a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Creating volume d7c3a694-0f89-4edb-8dcc-5d14bef1d370 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:53 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:53 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 1073741824 Sep 03 13:34:53 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:53 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b" returned: 0 in 0.682s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:53 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b Sep 03 13:34:53 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:53 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b5740dc-675a-4144-abf9-016c39e5e39b" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-1b5740dc-675a-4144-abf9-016c39e5e39b" released by "delete_volume" :: held 1.036s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:53 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Created reservations ['ceb6b6b7-242a-464b-8a2e-15d7221f0d16', '17733681-7478-413e-9ef9-e9e471e85c02', '69187756-53fe-4bab-b736-f574507b7569', '016d8539-1386-4149-b766-49d59b9430c1'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 1073741824" returned: 0 in 0.558s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:53 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 Sep 03 13:34:53 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:54 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:54 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:54 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890d9982-f41f-4461-8dc8-f0ccd0a282c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3563c8f0-4d13-46bc-8383-e20364398708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Volume volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 (d7c3a694-0f89-4edb-8dcc-5d14bef1d370): created successfully Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3563c8f0-4d13-46bc-8383-e20364398708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Flow 'volume_create_manager' (ecb7f79e-f980-4b50-b74c-a3a5d15f3f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:54 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.624s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-13121322-5326-4881-9f73-35f244c4ec07 tempest-VolumesTestJSON-2141935760 None] Created volume successfully. Sep 03 13:34:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Deleted volume successfully. Sep 03 13:34:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-716b2577-b31a-4afe-b390-583927105cdd tempest-VolumesActionsTest-439197764 None] Lock "cinder-1b5740dc-675a-4144-abf9-016c39e5e39b-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (40368a19-a920-4da6-b19b-0e4153de39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988171b9-6f3f-4c1f-b7a7-25c6b3b68297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988171b9-6f3f-4c1f-b7a7-25c6b3b68297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447158152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bb7696-1c8b-4bfa-955e-06714b750059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:56Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785fed77-8ee5-49c6-bfc7-900c44d9d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785fed77-8ee5-49c6-bfc7-900c44d9d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7c9e5-21f2-4b7a-a377-88fa96fe327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7c9e5-21f2-4b7a-a377-88fa96fe327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bb7696-1c8b-4bfa-955e-06714b750059', 'volume_name': 'volume-70bb7696-1c8b-4bfa-955e-06714b750059', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f2aa50-9bd5-46a1-9c53-c4548385cbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f2aa50-9bd5-46a1-9c53-c4548385cbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cef5ff-f4f1-426e-b042-b38ee605a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Volume 70bb7696-1c8b-4bfa-955e-06714b750059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bb7696-1c8b-4bfa-955e-06714b750059', 'volume_size': 1} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447158152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bb7696-1c8b-4bfa-955e-06714b750059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:34:56Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Creating volume 70bb7696-1c8b-4bfa-955e-06714b750059 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:34:56 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:34:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:56 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 1073741824 Sep 03 13:34:56 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-d7c3a694-0f89-4edb-8dcc-5d14bef1d370-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "cinder-d7c3a694-0f89-4edb-8dcc-5d14bef1d370-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:57 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 1073741824" returned: 0 in 0.805s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-quobyte-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ecc317-da80-4489-b905-edda5a12f0cb]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:57 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 Sep 03 13:34:57 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:57 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 Sep 03 13:34:57 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:57 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059" returned: 0 in 0.309s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cef5ff-f4f1-426e-b042-b38ee605a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bb7696-1c8b-4bfa-955e-06714b750059', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a6af76-bf8f-4103-a3be-3afdd80acaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:34:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Volume volume-70bb7696-1c8b-4bfa-955e-06714b750059 (70bb7696-1c8b-4bfa-955e-06714b750059): created successfully Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a6af76-bf8f-4103-a3be-3afdd80acaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (40368a19-a920-4da6-b19b-0e4153de39e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:34:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-40f8272e-b772-4eef-a846-7e2a0f987997 tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:34:57 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" returned: 0 in 0.723s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:57 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370 Sep 03 13:34:57 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:58 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" returned: 0 in 0.471s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-d7c3a694-0f89-4edb-8dcc-5d14bef1d370" released by "delete_volume" :: held 1.262s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-70bb7696-1c8b-4bfa-955e-06714b750059-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Created reservations ['1250db8d-a595-4560-8c4f-f328097defc1', '3b600170-a9dd-486d-a0d1-86f406d09051', 'a859a536-c5d8-4240-b0c0-3c0b494eb5a7', '9033d1f6-f917-49db-a90a-66b6fe96e51d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "cinder-70bb7696-1c8b-4bfa-955e-06714b750059-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Acquiring lock "cinder-quobyte-70bb7696-1c8b-4bfa-955e-06714b750059" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-70bb7696-1c8b-4bfa-955e-06714b750059" acquired by "delete_volume" :: waited 0.091s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:58 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:34:58 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1dec9-1713-48f2-9584-9ca51405072b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:59 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 Sep 03 13:34:59 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:59 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.615s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:34:59 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Deleted volume successfully. Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6b2e575b-0bcc-405a-a3b7-7e6bdebb8e8b tempest-VolumesTestJSON-2141935760 None] Lock "cinder-d7c3a694-0f89-4edb-8dcc-5d14bef1d370-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:34:59 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059" returned: 0 in 0.642s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:34:59 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059 Sep 03 13:34:59 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-e982ef26-09d2-4539-9290-dc23dcb277a4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-e982ef26-09d2-4539-9290-dc23dcb277a4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-quobyte-e982ef26-09d2-4539-9290-dc23dcb277a4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-e982ef26-09d2-4539-9290-dc23dcb277a4" acquired by "delete_volume" :: waited 0.048s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd34172-f7ad-461f-abf3-fd53ffe88196]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:34:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:00 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-70bb7696-1c8b-4bfa-955e-06714b750059" returned: 0 in 0.610s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "cinder-quobyte-70bb7696-1c8b-4bfa-955e-06714b750059" released by "delete_volume" :: held 1.364s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:00 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 Sep 03 13:35:00 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Created reservations ['d89004fb-97b1-4927-baa4-4b816ffafaa5', 'b9ec8124-ba3e-487d-9905-9970bd74d765', '03627cfc-c525-4b30-8052-ffe8068c1550', 'bd2948d9-d5da-41d4-9e5a-b3fa7e17f8d4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:00 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:00 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:00 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4" returned: 0 in 0.783s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:00 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4 Sep 03 13:35:00 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:00 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.546s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Deleted volume successfully. Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-47c7d33e-0d6f-4158-8b40-d8363cd95b9e tempest-VolumesActionsTest-439197764 None] Lock "cinder-70bb7696-1c8b-4bfa-955e-06714b750059-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:01 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e982ef26-09d2-4539-9290-dc23dcb277a4" returned: 0 in 0.514s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-e982ef26-09d2-4539-9290-dc23dcb277a4" released by "delete_volume" :: held 1.399s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Created reservations ['e2816ec7-00f0-4388-b523-a09261aba434', 'f93d2515-3079-4913-9989-b41014314a13', '89fed995-0b96-47bb-854a-b5652ecf1826', '306daa54-2c87-4f4b-80c5-207b398be19b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:01 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:01 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-ab4b45a2-29b6-4d67-8883-ac53a819b7f4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-ab4b45a2-29b6-4d67-8883-ac53a819b7f4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:02 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.817s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (20c2a257-009f-4717-b374-1e51e69898c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3ba5e8-c8b2-4a01-a7ea-41f253e6b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Deleted volume successfully. Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "cinder-quobyte-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3ba5e8-c8b2-4a01-a7ea-41f253e6b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-438494733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e702f24-a547-4089-b16c-b14eeb52f13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:02Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d77eb90-bad5-4a67-b8f5-e82f23d78519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d77eb90-bad5-4a67-b8f5-e82f23d78519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b48344a-4804-4a86-8cf9-1105a244e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b48344a-4804-4a86-8cf9-1105a244e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e702f24-a547-4089-b16c-b14eeb52f13e', 'volume_name': 'volume-6e702f24-a547-4089-b16c-b14eeb52f13e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618238b-a820-466b-b99b-1d3ff49cb38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618238b-a820-466b-b99b-1d3ff49cb38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d12a31a-8dd6-4062-9af4-79fb9f27c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:02 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Volume 6e702f24-a547-4089-b16c-b14eeb52f13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e702f24-a547-4089-b16c-b14eeb52f13e', 'volume_size': 1} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-438494733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e702f24-a547-4089-b16c-b14eeb52f13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6712ea69224ee89fdb6ed56a388ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:02Z,use_quota=True,user_id='fe247b21c5604d199da3499a07aef866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Creating volume 6e702f24-a547-4089-b16c-b14eeb52f13e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:02 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b098a8e6-8a10-487d-88dc-79e8ad9f3f46 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-e982ef26-09d2-4539-9290-dc23dcb277a4-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:02 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e 1073741824 Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" acquired by "delete_volume" :: waited 0.125s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:02 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ec1f4-1170-4c56-9817-e8bec73fc836]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:02 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 Sep 03 13:35:02 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:03 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e 1073741824" returned: 0 in 0.887s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:03 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e Sep 03 13:35:03 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:03 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" returned: 0 in 0.965s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:03 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4 Sep 03 13:35:03 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:03 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" returned: 0 in 0.347s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-quobyte-ab4b45a2-29b6-4d67-8883-ac53a819b7f4" released by "delete_volume" :: held 1.376s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:04 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e" returned: 0 in 0.523s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d12a31a-8dd6-4062-9af4-79fb9f27c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e702f24-a547-4089-b16c-b14eeb52f13e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955b5055-c5d6-4817-885b-6b322a3c4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Created reservations ['ca590928-0840-4c82-8314-a10ff2e756a6', '727e9aae-8657-4604-aa63-3e35ba66287a', '75fa4a42-13b6-44fd-86f3-803ee28239cd', 'b45da90f-c541-4dce-b384-c797ec88fea6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Volume volume-6e702f24-a547-4089-b16c-b14eeb52f13e (6e702f24-a547-4089-b16c-b14eeb52f13e): created successfully Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955b5055-c5d6-4817-885b-6b322a3c4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Flow 'volume_create_manager' (20c2a257-009f-4717-b374-1e51e69898c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5ae66a0e-cd1d-4a0c-b112-bc1c105e1fb2 tempest-VolumesActionsTest-545246208 None] Created volume successfully. Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:04 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:04 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:04 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.518s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Deleted volume successfully. Sep 03 13:35:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cce8de16-5888-449f-8aaa-0dea1fcd02c0 tempest-VolumesTestJSON-2141935760 None] Lock "cinder-ab4b45a2-29b6-4d67-8883-ac53a819b7f4-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-6e702f24-a547-4089-b16c-b14eeb52f13e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "cinder-6e702f24-a547-4089-b16c-b14eeb52f13e-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Acquiring lock "cinder-quobyte-6e702f24-a547-4089-b16c-b14eeb52f13e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "cinder-quobyte-6e702f24-a547-4089-b16c-b14eeb52f13e" acquired by "delete_volume" :: waited 0.048s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6285f0-5b6f-4bc8-81d1-c933dd45c849]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:05 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e Sep 03 13:35:05 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-e1b70172-a08f-4ec2-8bb0-dca02c170bdb tempest-ServerActionsTestOtherA-518335211 None] Terminate volume connection completed successfully. Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-e1b70172-a08f-4ec2-8bb0-dca02c170bdb tempest-ServerActionsTestOtherA-518335211 None] Deleting attachment e7cb8f8e-357a-4723-b731-560c006521f0. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:35:06 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e" returned: 0 in 0.556s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:06 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e Sep 03 13:35:06 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:06 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6e702f24-a547-4089-b16c-b14eeb52f13e" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "cinder-quobyte-6e702f24-a547-4089-b16c-b14eeb52f13e" released by "delete_volume" :: held 0.938s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Created reservations ['bba93667-3b87-4991-b6da-5cf0da06c459', '7f279434-48a7-4914-bba8-863ed9724481', '60f7c439-5980-47f1-8a92-cf919cbc915a', '21f5c3c2-3a85-4d5b-b8ce-7f71d6bfea67'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:06 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:06 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:07 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.413s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:07 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Deleted volume successfully. Sep 03 13:35:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-28550b3f-e050-49fd-a2cc-4ee8ab418d6a tempest-VolumesActionsTest-545246208 None] Lock "cinder-6e702f24-a547-4089-b16c-b14eeb52f13e-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1b43ec0c-653a-4405-9d85-1cc73b39e03b tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-502845417: creating Sep 03 13:35:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1b43ec0c-653a-4405-9d85-1cc73b39e03b tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-502845417: created successfully Sep 03 13:35:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1b43ec0c-653a-4405-9d85-1cc73b39e03b tempest-GroupSnapshotsTest-1737489660 None] Create group completed successfully. Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=101,cinder:INSERT=31,cinder:UPDATE=138,cinder:DELETE=10 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (42333ac9-a406-4736-95a8-d13268a63544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69f2770-1e22-4934-91c3-d74ecc98bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69f2770-1e22-4934-91c3-d74ecc98bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117699552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70ee551a-9682-4bdd-a73d-56331a171a63,host='devstack@QuobyteHD#QuobyteHD',id=b821bfc7-a26e-4ad7-8b62-12d1731d4fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:12Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29180562-cbdd-462b-b16b-5e3d5aaa43f0),volume_type_id=29180562-cbdd-462b-b16b-5e3d5aaa43f0)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae589ec-6c4a-4242-a381-00099884daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae589ec-6c4a-4242-a381-00099884daad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adc3ffb-9e0d-45e2-a831-54fd8a8ec9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adc3ffb-9e0d-45e2-a831-54fd8a8ec9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b821bfc7-a26e-4ad7-8b62-12d1731d4fa3', 'volume_name': 'volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a50a28-d221-44be-9abd-249781e598e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a50a28-d221-44be-9abd-249781e598e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41163468-b86e-4aa0-bdaa-72b4b128da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:11 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Volume b821bfc7-a26e-4ad7-8b62-12d1731d4fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3', 'volume_size': 1} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70ee551a-9682-4bdd-a73d-56331a171a63,created_at=2026-09-03T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117699552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70ee551a-9682-4bdd-a73d-56331a171a63,host='devstack@QuobyteHD#QuobyteHD',id=b821bfc7-a26e-4ad7-8b62-12d1731d4fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:12Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29180562-cbdd-462b-b16b-5e3d5aaa43f0),volume_type_id=29180562-cbdd-462b-b16b-5e3d5aaa43f0)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Creating volume b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:11 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:11 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 1073741824 Sep 03 13:35:11 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:12 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 1073741824" returned: 0 in 0.527s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:12 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:12 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:12 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 0.289s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41163468-b86e-4aa0-bdaa-72b4b128da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7011b101-2300-4bea-aad7-85b420064682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Volume volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 (b821bfc7-a26e-4ad7-8b62-12d1731d4fa3): created successfully Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7011b101-2300-4bea-aad7-85b420064682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (42333ac9-a406-4736-95a8-d13268a63544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9b8b3149-fc77-4e7c-b1dc-0d4e9f340e56 tempest-GroupSnapshotsTest-1737489660 None] Created volume successfully. Sep 03 13:35:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] GroupSnapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: creating. Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Group snapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: creating. {{(pid=86933) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Creating offline snapshot 3e51b595-ef1a-474f-b659-820025009a4e of volume b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a2a92-4ab9-4b8e-a83f-4c797542cd5d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:13 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:13 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:14 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 0.517s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:14 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e 1G Sep 03 13:35:14 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-28c332cd-ed17-40db-b7fe-d26c7c92acc1 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:14 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e 1G" returned: 0 in 0.674s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:14 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:14 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:15 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.333s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:15 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:15 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:15 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:15 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.312s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:15 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info Sep 03 13:35:15 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:15 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:15 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:15 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info Sep 03 13:35:15 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:16 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.info" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-28c332cd-ed17-40db-b7fe-d26c7c92acc1 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.614s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-28c332cd-ed17-40db-b7fe-d26c7c92acc1 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-28c332cd-ed17-40db-b7fe-d26c7c92acc1 tempest-ServerActionsTestOtherA-518335211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd50ce39a-8750-4dfa-8ec7-32b5bf0a5838', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:35:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2e43c460-e288-4281-b9dc-e3dfbc6ca2d5 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: created successfully Sep 03 13:35:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-0cbba1d8-956b-46be-96de-887d12a9a511 req-28c332cd-ed17-40db-b7fe-d26c7c92acc1 tempest-ServerActionsTestOtherA-518335211 None] attachment_update completed successfully. Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Creating volume 2fe5a615-38b2-4770-8ea0-e0ef70bdb04e from snapshot 3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] snapshot: 3e51b595-ef1a-474f-b659-820025009a4e, volume: 2fe5a615-38b2-4770-8ea0-e0ef70bdb04e, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3c29ad-6ba2-4576-b950-6a9af3dcd010]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:18 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:18 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:18 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.759s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee0c22-265b-4947-a704-05406d7f5515]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:19 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:19 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:19 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 0.537s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:35:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:19 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e Sep 03 13:35:19 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:35:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=130,cinder:UPDATE=133,cinder:DELETE=13,cinder:INSERT=43 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:35:29 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" returned: 0 in 9.674s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3, size 1024.00 MB, duration 9.67 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:35:29 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Converted 1024.00 MB image at 105.85 MB/s Sep 03 13:35:29 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:29 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e Sep 03 13:35:29 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:29 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" released by "_copy_volume_from_snapshot" :: held 11.508s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" released by "_create_volume_from_snapshot" :: held 11.641s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.670s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7382c92b-f7b8-4833-a50e-e94edd940208 tempest-GroupSnapshotsTest-1737489660 None] Create group from source-snapshot-f51f1bc6-9b4f-42ce-9335-f2753c1fca81 completed successfully. Sep 03 13:35:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" acquired by "delete_volume" :: waited 0.051s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb14e7c-a5b7-42f4-a744-1dfc5b292f5c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:31 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e Sep 03 13:35:31 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:31 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" returned: 0 in 0.492s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:31 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e Sep 03 13:35:31 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:32 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2fe5a615-38b2-4770-8ea0-e0ef70bdb04e" released by "delete_volume" :: held 1.018s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['d5baf0ea-d0fa-4484-bf60-2bba7594a4d8'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:32 devstack cinder-volume[86933]: WARNING cinder.quota [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-795396998 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-795396998, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:35:32 devstack cinder-volume[86933]: WARNING cinder.quota [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-795396998 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-795396998, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['84d157bb-c2e3-40f4-863e-26c2db38b600', 'ef48a352-bd28-4517-aef8-a9cda93286c8', 'e7dfba65-1a57-4a98-b641-eb5f805622bb', '728e7d4f-7416-4ac1-81d0-3a6241df6bc5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:32 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:32 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: deleting Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: deleting {{(pid=86933) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Deleting offline snapshot 3e51b595-ef1a-474f-b659-820025009a4e of volume b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] snapshot_file for this snap is: volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:35:33 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.570s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd71404b-a65a-4167-972f-7b2f77c0962e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-009d7991-ab23-4cb6-87c3-8d39fa90d195 tempest-GroupSnapshotsTest-1737489660 None] Delete group completed successfully. Sep 03 13:35:33 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:33 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:33 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.538s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a826b8-8cc2-4744-a1e2-fa9ba0d87d9d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:33 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:33 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:33 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:33 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:34 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.994s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:35:34 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 1.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:34 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:34 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.623s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:35 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:35 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e Sep 03 13:35:35 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:36 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3.3e51b595-ef1a-474f-b659-820025009a4e" returned: 0 in 0.517s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-3e51b595-ef1a-474f-b659-820025009a4e" released by "_delete_snapshot" :: held 3.154s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" released by "delete_snapshot" :: held 3.207s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:36 devstack cinder-volume[86933]: WARNING cinder.quota [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-795396998 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-795396998, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:35:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['36b31053-7bfc-42d3-8966-fbfba70a4d65', '37f6e0ef-0b9a-471e-913a-2e36f5f0bc65', '88144220-262b-4332-a7ce-80563d993801', '0cd72f12-71f6-42b3-ab74-7d0d521dd1b2'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e676e101-7a51-4944-9fd2-1fec8e577de5 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot f51f1bc6-9b4f-42ce-9335-f2753c1fca81: deleted successfully Sep 03 13:35:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79337de-278c-413c-89f9-c5d9f3f46570]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:38 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:38 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:38 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 0.606s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:38 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3 Sep 03 13:35:38 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (0f10b9c3-324d-4c2b-92fc-916fe825cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03665976-9b72-4286-84aa-4f6a68fb8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03665976-9b72-4286-84aa-4f6a68fb8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1910644787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c5496f-8b19-4ae9-a944-4788e7ba3db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:39Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b75ea1-326a-41e2-900d-6d7caa90b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b75ea1-326a-41e2-900d-6d7caa90b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca866389-6c00-4074-bd38-280b0e4f8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca866389-6c00-4074-bd38-280b0e4f8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c5496f-8b19-4ae9-a944-4788e7ba3db9', 'volume_name': 'volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d83275-22b9-48ac-9d3c-5574535f8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d83275-22b9-48ac-9d3c-5574535f8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c6c6d3-a6fb-413a-9888-0e87a31de957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Volume 94c5496f-8b19-4ae9-a944-4788e7ba3db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9', 'volume_size': 1} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1910644787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c5496f-8b19-4ae9-a944-4788e7ba3db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:39Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Creating volume 94c5496f-8b19-4ae9-a944-4788e7ba3db9 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:39 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:39 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 1073741824 Sep 03 13:35:39 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:39 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" returned: 0 in 0.503s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-b821bfc7-a26e-4ad7-8b62-12d1731d4fa3" released by "delete_volume" :: held 1.210s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['10a02719-7b3f-466e-a429-63ec0c25f399'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:39 devstack cinder-volume[86933]: WARNING cinder.db.api [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-795396998'] Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['49f4efcd-7821-4b27-b031-fcb1f782b574', '7833de57-fe73-4514-a4b1-ab50c8cf955d', '38623697-196b-402d-a976-ab7cbd10b614', '720fe487-ae3c-4b90-8694-47858b06cf3c'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:39 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:39 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:40 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 1073741824" returned: 0 in 1.009s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:40 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 Sep 03 13:35:40 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:40 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.429s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a884d52-9fcb-4cb9-a382-48087e447022 tempest-GroupSnapshotsTest-1737489660 None] Delete group completed successfully. Sep 03 13:35:40 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9" returned: 0 in 0.315s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c6c6d3-a6fb-413a-9888-0e87a31de957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c572c4-66da-478f-b2a8-5ef856eb95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Volume volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 (94c5496f-8b19-4ae9-a944-4788e7ba3db9): created successfully Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c572c4-66da-478f-b2a8-5ef856eb95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (0f10b9c3-324d-4c2b-92fc-916fe825cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-31f71da9-4be7-4d5e-8178-fecbb09205bb tempest-VolumesListAdminTestJSON-1881514270 None] Created volume successfully. Sep 03 13:35:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-204e1461-7f2a-4d70-a6de-de7ea5273afa tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-1002408729: creating Sep 03 13:35:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-204e1461-7f2a-4d70-a6de-de7ea5273afa tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-1002408729: created successfully Sep 03 13:35:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-204e1461-7f2a-4d70-a6de-de7ea5273afa tempest-GroupSnapshotsTest-1737489660 None] Create group completed successfully. Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (06f7dc03-5e36-42f4-a7a9-3a5703b789ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14512cfb-2287-483d-9a03-115fdc17b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14512cfb-2287-483d-9a03-115fdc17b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1724525963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f7ea42-ad38-4d1c-a8f7-032edf209023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:41Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f97f52f-3953-4018-9fef-568351a489f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f97f52f-3953-4018-9fef-568351a489f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b99440-04dd-4770-99b1-bc59b9f78d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b99440-04dd-4770-99b1-bc59b9f78d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f7ea42-ad38-4d1c-a8f7-032edf209023', 'volume_name': 'volume-87f7ea42-ad38-4d1c-a8f7-032edf209023', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df5214-5e25-4ce1-a711-382fb01b4e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df5214-5e25-4ce1-a711-382fb01b4e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e4b816-6731-490f-860a-42e25dce6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:41 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Volume 87f7ea42-ad38-4d1c-a8f7-032edf209023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f7ea42-ad38-4d1c-a8f7-032edf209023', 'volume_size': 1} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1724525963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f7ea42-ad38-4d1c-a8f7-032edf209023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:41Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Creating volume 87f7ea42-ad38-4d1c-a8f7-032edf209023 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:41 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:41 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 1073741824 Sep 03 13:35:41 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:41 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 1073741824" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:41 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 Sep 03 13:35:41 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:42 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e4b816-6731-490f-860a-42e25dce6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f7ea42-ad38-4d1c-a8f7-032edf209023', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaff6618-e84d-4a34-ad3e-9ced88452956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:42 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Volume volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 (87f7ea42-ad38-4d1c-a8f7-032edf209023): created successfully Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaff6618-e84d-4a34-ad3e-9ced88452956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (06f7dc03-5e36-42f4-a7a9-3a5703b789ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b4b22938-7265-49d3-98d5-528f64da64b4 tempest-VolumesListAdminTestJSON-1881514270 None] Created volume successfully. Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (efa178b5-9c38-4700-84b0-55ec8e61e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8828bb70-ab2e-4ba3-b312-f498a9a5494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8828bb70-ab2e-4ba3-b312-f498a9a5494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1357405322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd09ba77-290f-4d38-b89d-1d0fde581620,host='devstack@QuobyteHD#QuobyteHD',id=2b43e40b-0870-4b30-a4ac-8a99d9506d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:43Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281d481c-485a-4be6-aec8-c867001d01bb),volume_type_id=281d481c-485a-4be6-aec8-c867001d01bb)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b464ad7c-c32e-446d-8374-a4a326dccd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b464ad7c-c32e-446d-8374-a4a326dccd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8112a9c-9b3e-45a3-95d4-b937807cfa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8112a9c-9b3e-45a3-95d4-b937807cfa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b43e40b-0870-4b30-a4ac-8a99d9506d3e', 'volume_name': 'volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd2c52-7036-443a-bf09-70134edbd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd2c52-7036-443a-bf09-70134edbd91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348381b7-aaa5-4494-bb6d-ba50ece60032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Volume 2b43e40b-0870-4b30-a4ac-8a99d9506d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e', 'volume_size': 1} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd09ba77-290f-4d38-b89d-1d0fde581620,created_at=2026-09-03T11:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1357405322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd09ba77-290f-4d38-b89d-1d0fde581620,host='devstack@QuobyteHD#QuobyteHD',id=2b43e40b-0870-4b30-a4ac-8a99d9506d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:43Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281d481c-485a-4be6-aec8-c867001d01bb),volume_type_id=281d481c-485a-4be6-aec8-c867001d01bb)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Creating volume 2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:43 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e 1073741824 Sep 03 13:35:43 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (d42be066-2106-43d5-94fc-184af37c0094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a5800f-af73-4b6d-a10d-c525ee1cdd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a5800f-af73-4b6d-a10d-c525ee1cdd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-69290553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4dc2a5-6cfd-43eb-9e23-062ef7075c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:43Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff54918-041c-4506-b688-3b1dafb04ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff54918-041c-4506-b688-3b1dafb04ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18b4e6-5f35-443c-9009-043bdd744ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18b4e6-5f35-443c-9009-043bdd744ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4dc2a5-6cfd-43eb-9e23-062ef7075c20', 'volume_name': 'volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b8a263-786b-4029-b653-dd82193da1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b8a263-786b-4029-b653-dd82193da1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4535df-5aec-4ae1-b8fe-a987f58df775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Volume 6a4dc2a5-6cfd-43eb-9e23-062ef7075c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20', 'volume_size': 1} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:43 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e 1073741824" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:43 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e Sep 03 13:35:43 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:43 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-69290553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4dc2a5-6cfd-43eb-9e23-062ef7075c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7a8fd9364f46a96d657822ffae99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:43Z,use_quota=True,user_id='87c48ae94a46483abd45ebb897ad1141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Creating volume 6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348381b7-aaa5-4494-bb6d-ba50ece60032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e1ceb6-d1c5-4564-9a8c-0f5028db0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:43 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 1073741824 Sep 03 13:35:43 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Volume volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e (2b43e40b-0870-4b30-a4ac-8a99d9506d3e): created successfully Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e1ceb6-d1c5-4564-9a8c-0f5028db0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (efa178b5-9c38-4700-84b0-55ec8e61e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cdb923cd-4e72-4b66-ac65-5122585ccbc2 tempest-GroupSnapshotsTest-1737489660 None] Created volume successfully. Sep 03 13:35:44 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 1073741824" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:44 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 Sep 03 13:35:44 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:44 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" returned: 0 in 0.274s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4535df-5aec-4ae1-b8fe-a987f58df775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a89872-6496-4da3-96fb-bb33cfe084f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Volume volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 (6a4dc2a5-6cfd-43eb-9e23-062ef7075c20): created successfully Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a89872-6496-4da3-96fb-bb33cfe084f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Flow 'volume_create_manager' (d42be066-2106-43d5-94fc-184af37c0094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-69e1d3f8-7a8a-436b-b2e0-aa9771222c45 tempest-VolumesListAdminTestJSON-1881514270 None] Created volume successfully. Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (d0619c3d-788e-4349-a567-a8f8ba0bb380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09954421-e80b-4081-88cc-2b45113855df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09954421-e80b-4081-88cc-2b45113855df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-459631243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd09ba77-290f-4d38-b89d-1d0fde581620,host='devstack@QuobyteHD#QuobyteHD',id=d29da240-8826-4a87-bdad-412dd97cc297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:45Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281d481c-485a-4be6-aec8-c867001d01bb),volume_type_id=281d481c-485a-4be6-aec8-c867001d01bb)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffda09b6-733d-411c-90cb-d6422d95098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffda09b6-733d-411c-90cb-d6422d95098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b53c41-b5e3-4a17-971d-f5d1abe0f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b53c41-b5e3-4a17-971d-f5d1abe0f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29da240-8826-4a87-bdad-412dd97cc297', 'volume_name': 'volume-d29da240-8826-4a87-bdad-412dd97cc297', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa7099-ac91-4324-9602-9f12a9867c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa7099-ac91-4324-9602-9f12a9867c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e88fc-e314-4e98-a49b-8a233b6f359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Volume d29da240-8826-4a87-bdad-412dd97cc297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29da240-8826-4a87-bdad-412dd97cc297', 'volume_size': 1} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd09ba77-290f-4d38-b89d-1d0fde581620,created_at=2026-09-03T11:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-459631243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd09ba77-290f-4d38-b89d-1d0fde581620,host='devstack@QuobyteHD#QuobyteHD',id=d29da240-8826-4a87-bdad-412dd97cc297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:45Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281d481c-485a-4be6-aec8-c867001d01bb),volume_type_id=281d481c-485a-4be6-aec8-c867001d01bb)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Creating volume d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:44 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:44 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 1073741824 Sep 03 13:35:44 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:45 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 1073741824" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:45 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 Sep 03 13:35:45 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:45 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e88fc-e314-4e98-a49b-8a233b6f359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29da240-8826-4a87-bdad-412dd97cc297', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aaa116-9538-4e8d-9f99-df1d4847c716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Volume volume-d29da240-8826-4a87-bdad-412dd97cc297 (d29da240-8826-4a87-bdad-412dd97cc297): created successfully Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aaa116-9538-4e8d-9f99-df1d4847c716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (d0619c3d-788e-4349-a567-a8f8ba0bb380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3b4592e5-7d97-484d-99b8-06ea905a2c6d tempest-GroupSnapshotsTest-1737489660 None] Created volume successfully. Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Flow 'volume_create_manager' (1f4a42d0-0287-4cfe-91bf-4be99fde898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b1f17-80d3-416f-9624-bdcdf378ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b1f17-80d3-416f-9624-bdcdf378ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c4795-b9c1-4aed-b97e-582f6fc25853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0950e700104ab3ad38d39383695f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:46Z,use_quota=True,user_id='b9ad429964d34c7e903505fcab13ee90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a6f184-0ebc-4d50-be80-617641ed8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a6f184-0ebc-4d50-be80-617641ed8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d82ca4-8e2e-42f0-825a-d26eb1335db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d82ca4-8e2e-42f0-825a-d26eb1335db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315c4795-b9c1-4aed-b97e-582f6fc25853', 'volume_name': 'volume-315c4795-b9c1-4aed-b97e-582f6fc25853', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be07fce-76f3-4d46-b322-73e717027de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be07fce-76f3-4d46-b322-73e717027de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199c3e6-0ed8-4e38-bb87-767b86721d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Volume 315c4795-b9c1-4aed-b97e-582f6fc25853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315c4795-b9c1-4aed-b97e-582f6fc25853', 'volume_size': 1} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c4795-b9c1-4aed-b97e-582f6fc25853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0950e700104ab3ad38d39383695f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:46Z,use_quota=True,user_id='b9ad429964d34c7e903505fcab13ee90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Creating volume 315c4795-b9c1-4aed-b97e-582f6fc25853 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:35:45 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:35:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:45 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 1073741824 Sep 03 13:35:45 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d2f954b1-b257-4387-b866-2c95b31ffb56 tempest-GroupSnapshotsTest-1737489660 None] Update group completed successfully. Sep 03 13:35:46 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 1073741824" returned: 0 in 0.466s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:46 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 Sep 03 13:35:46 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:46 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199c3e6-0ed8-4e38-bb87-767b86721d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315c4795-b9c1-4aed-b97e-582f6fc25853', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ece89b8-6881-4696-9a0d-496c5b555965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Volume volume-315c4795-b9c1-4aed-b97e-582f6fc25853 (315c4795-b9c1-4aed-b97e-582f6fc25853): created successfully Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ece89b8-6881-4696-9a0d-496c5b555965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Flow 'volume_create_manager' (1f4a42d0-0287-4cfe-91bf-4be99fde898a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-026c0405-cb5a-41df-8854-80093ec09fa7 tempest-VolumesListAdminTestJSON-986952217 None] Created volume successfully. Sep 03 13:35:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4fd87308-f64c-4938-a0a6-55a85c91c3cc tempest-GroupSnapshotsTest-1737489660 None] Update group completed successfully. Sep 03 13:35:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Acquiring lock "cinder-315c4795-b9c1-4aed-b97e-582f6fc25853-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "cinder-315c4795-b9c1-4aed-b97e-582f6fc25853-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Acquiring lock "cinder-quobyte-315c4795-b9c1-4aed-b97e-582f6fc25853" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "cinder-quobyte-315c4795-b9c1-4aed-b97e-582f6fc25853" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f896f-76ce-4634-b3fa-a41a3d995188]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-quobyte-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c8dab4-681f-4580-881b-82c38638508b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:48 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 Sep 03 13:35:48 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:48 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 Sep 03 13:35:48 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d305c1a7-ff06-4bee-b9aa-08f7e7df2e69 tempest-GroupSnapshotsTest-1737489660 None] Update group completed successfully. Sep 03 13:35:48 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853" returned: 0 in 0.600s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:48 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853 Sep 03 13:35:48 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:48 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" returned: 0 in 0.510s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:48 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20 Sep 03 13:35:48 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:49 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-315c4795-b9c1-4aed-b97e-582f6fc25853" returned: 0 in 0.318s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "cinder-quobyte-315c4795-b9c1-4aed-b97e-582f6fc25853" released by "delete_volume" :: held 0.977s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Created reservations ['f358d75e-5b53-44fb-921d-ad1f87f001e3', '86fa3e9d-66dd-4e69-a16a-e14982f648c2', '9224152d-a6de-4302-86d9-868ec3f51037', 'ca1f2b13-f0db-4e17-9851-62c12a09b552'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:49 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" returned: 0 in 0.320s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20" released by "delete_volume" :: held 0.906s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:49 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:49 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Created reservations ['210d967a-c7ff-410a-ace0-5d39932e96ef', 'c3c1ad5f-081c-4f16-8bf5-eee73106a175', '7c9b3b0b-55b6-468f-9ab5-9565f0514701', '1fbea1be-e829-42ad-9e4b-ffef3c693ebd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:49 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:49 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:49 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.393s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Deleted volume successfully. Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-83cb77f9-a52a-4c1f-82b9-18d12d570a04 tempest-VolumesListAdminTestJSON-986952217 None] Lock "cinder-315c4795-b9c1-4aed-b97e-582f6fc25853-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-87f7ea42-ad38-4d1c-a8f7-032edf209023-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-87f7ea42-ad38-4d1c-a8f7-032edf209023-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-quobyte-87f7ea42-ad38-4d1c-a8f7-032edf209023" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-87f7ea42-ad38-4d1c-a8f7-032edf209023" acquired by "delete_volume" :: waited 0.047s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:49 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.513s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98219f4-cbf0-489c-a3fc-75059cc2399a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Deleted volume successfully. Sep 03 13:35:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17cc42d7-2ccf-4ebd-a1e8-d42707ce6470 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-6a4dc2a5-6cfd-43eb-9e23-062ef7075c20-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9012f599-3e64-4cdb-92e7-134baf97c731 tempest-GroupSnapshotsTest-1737489660 None] Update group completed successfully. Sep 03 13:35:50 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 Sep 03 13:35:50 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:50 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:50 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023 Sep 03 13:35:50 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:50 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-87f7ea42-ad38-4d1c-a8f7-032edf209023" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-87f7ea42-ad38-4d1c-a8f7-032edf209023" released by "delete_volume" :: held 0.717s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Created reservations ['2508354b-08b3-4b0d-814d-5500124eaefa', '1147e15b-441f-4f12-8b59-324b96b6ca60', 'abd731be-3bd3-45b1-ac14-6a02898cb6ee', 'c0a62e02-15bf-48c3-9041-366413b30ad6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:50 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:50 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:50 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:50 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Deleted volume successfully. Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-94c5496f-8b19-4ae9-a944-4788e7ba3db9-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bf5496be-9841-4b37-9d7a-36ac3302ce49 tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-87f7ea42-ad38-4d1c-a8f7-032edf209023-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-94c5496f-8b19-4ae9-a944-4788e7ba3db9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "cinder-quobyte-94c5496f-8b19-4ae9-a944-4788e7ba3db9" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-94c5496f-8b19-4ae9-a944-4788e7ba3db9" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f014b-6b3a-4129-8692-f1ca1fa8bd33]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:51 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 Sep 03 13:35:51 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] GroupSnapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: creating. Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Group snapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: creating. {{(pid=86933) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Creating offline snapshot 1405b06e-2d64-4a18-9ef0-5b85298038ac of volume 2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:35:51 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfdb2c3-3019-4a33-b8d4-8d9ebedc1336]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:51 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9 Sep 03 13:35:51 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:51 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e Sep 03 13:35:51 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:51 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94c5496f-8b19-4ae9-a944-4788e7ba3db9" returned: 0 in 0.292s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-quobyte-94c5496f-8b19-4ae9-a944-4788e7ba3db9" released by "delete_volume" :: held 0.768s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Created reservations ['07545d4a-2e10-43d4-b477-e0987c458dbf', 'db4878ab-91cc-449b-bfa8-2dcd936d383b', 'cdc7e6db-f00d-4748-b1aa-80097439f1fe', 'c16c2b46-bb91-4595-8ca5-3cc8ea2399cd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:52 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" returned: 0 in 0.471s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:52 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:52 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:52 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac 1G Sep 03 13:35:52 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:52 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.449s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Deleted volume successfully. Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a3b47462-33c3-47b8-98d7-406509b6068e tempest-VolumesListAdminTestJSON-1881514270 None] Lock "cinder-94c5496f-8b19-4ae9-a944-4788e7ba3db9-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:52 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac 1G" returned: 0 in 0.762s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:52 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac Sep 03 13:35:52 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:53 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac" returned: 0 in 0.372s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:53 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:53 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac Sep 03 13:35:53 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:53 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:53 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info Sep 03 13:35:53 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:53 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info" returned: 0 in 0.324s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:53 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:53 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info Sep 03 13:35:53 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:54 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.info" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Creating offline snapshot 64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 of volume d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36994181-4c38-4b35-9e06-f6fb15b958be]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:54 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 Sep 03 13:35:54 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-57d2fbae-d2f7-41e3-8ea7-81d75bf89880 tempest-ServerActionsTestOtherA-518335211 None] Terminate volume connection completed successfully. Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-57d2fbae-d2f7-41e3-8ea7-81d75bf89880 tempest-ServerActionsTestOtherA-518335211 None] Deleting attachment d50ce39a-8750-4dfa-8ec7-32b5bf0a5838. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "cinder-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "cinder-quobyte-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-quobyte-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:54 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297" returned: 0 in 0.488s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a18010-1446-4e31-b43e-a36dd26d4689]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:54 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 1G Sep 03 13:35:54 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:54 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 Sep 03 13:35:54 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 1G" returned: 0 in 0.534s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29da240-8826-4a87-bdad-412dd97cc297 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:55 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" returned: 0 in 0.542s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:55 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29da240-8826-4a87-bdad-412dd97cc297 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 Sep 03 13:35:55 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84 Sep 03 13:35:55 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "cinder-070b9043-e8d8-4def-b601-9303f27c87ce-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-070b9043-e8d8-4def-b601-9303f27c87ce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "cinder-quobyte-070b9043-e8d8-4def-b601-9303f27c87ce" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-quobyte-070b9043-e8d8-4def-b601-9303f27c87ce" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0ba18-1ff7-42c6-a15f-ad178b9518c3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:55 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" returned: 0 in 0.319s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:55 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29da240-8826-4a87-bdad-412dd97cc297 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" returned: 0 in 0.360s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:55 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-quobyte-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84" released by "delete_volume" :: held 0.956s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:55 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 Sep 03 13:35:55 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce Sep 03 13:35:55 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.quota [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Created reservations ['e7fd078b-d78c-420c-b89b-58288f367b10', '6196edea-b9d7-4b84-be7f-86170bc85379', '36c1f21e-7a38-487b-8b67-3f1dfb8628ab', '75da3703-7be0-44bc-9d66-405c204c6fc9'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:55 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:55 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:55 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:56 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info Sep 03 13:35:56 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:56 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce" returned: 0 in 0.572s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:56 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce Sep 03 13:35:56 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:56 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.manager [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Deleted volume successfully. Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-6481f56c-55b3-45d9-965c-5c2c5b9342eb req-44069c4b-b013-43ce-be27-5b51aa5920d8 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-cb2ad80a-5cd7-4a0f-8a95-6adf0db53c84-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:56 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info" returned: 0 in 0.391s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:56 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info Sep 03 13:35:56 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:56 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-070b9043-e8d8-4def-b601-9303f27c87ce" returned: 0 in 0.317s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-quobyte-070b9043-e8d8-4def-b601-9303f27c87ce" released by "delete_volume" :: held 0.948s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Created reservations ['de6d119f-83e3-44fa-bee9-ed118ffd6717', 'a67ae470-598c-490f-a70c-4ea1657e8c18', '5001ccd7-1d35-41d3-8cbe-27d437943295', 'ed4ceb3f-f29a-47c9-9831-aa1da74325a0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:56 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:35:56 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:56 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.info" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:35:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6cf8109b-3ae1-4bb2-9ae5-d9dc4cd9f42f tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: created successfully Sep 03 13:35:56 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.311s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:35:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Deleted volume successfully. Sep 03 13:35:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-225f9b46-3753-422c-8dfb-a801b55c0760 tempest-ServerActionsTestOtherA-518335211 None] Lock "cinder-070b9043-e8d8-4def-b601-9303f27c87ce-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:35:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: deleting Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: deleting {{(pid=86933) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Flow 'volume_create_manager' (ba2c6cf8-428b-42a8-a07e-b3aaa5b5ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0c09a3-6a4d-40bc-86aa-c259d8c76438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0c09a3-6a4d-40bc-86aa-c259d8c76438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1112253568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00319b63-998c-45ef-a17f-4b08014f32c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d43b7ea999d46218b45400b83ba8a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:58Z,use_quota=True,user_id='d2cec280771e4c83b8acbb96fc60ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8873f52-da0d-44c5-a064-3e6bf4f07647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8873f52-da0d-44c5-a064-3e6bf4f07647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a102b7-edf9-4340-aea8-f3d5f112f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-1405b06e-2d64-4a18-9ef0-5b85298038ac" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-1405b06e-2d64-4a18-9ef0-5b85298038ac" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Deleting offline snapshot 1405b06e-2d64-4a18-9ef0-5b85298038ac of volume 2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] snapshot_file for this snap is: volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9e238-6507-495e-9dd4-6f8514303a18]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:58 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac Sep 03 13:35:58 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a102b7-edf9-4340-aea8-f3d5f112f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00319b63-998c-45ef-a17f-4b08014f32c3', 'volume_name': 'volume-00319b63-998c-45ef-a17f-4b08014f32c3', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb40d0-e22d-4c5f-9d6c-a993ba4cd998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb40d0-e22d-4c5f-9d6c-a993ba4cd998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543b2b2b-6ef4-474f-9868-e00479fdee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:35:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Volume 00319b63-998c-45ef-a17f-4b08014f32c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00319b63-998c-45ef-a17f-4b08014f32c3', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 13:35:58 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Trying to clone 00319b63-998c-45ef-a17f-4b08014f32c3 from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:35:59 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac" returned: 0 in 0.667s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e610efcf-8fbe-47f6-94c2-195ccb12919a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:35:59 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Image download 20.69 MB at 20.69 MB/s Sep 03 13:35:59 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e Sep 03 13:35:59 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12d7d29-1603-4563-990f-de2b164946a0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:59 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD Sep 03 13:35:59 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:59 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" returned: 0 in 0.557s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:35:59 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac Sep 03 13:35:59 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:35:59 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:35:59 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 is fetched for user d2cec280771e4c83b8acbb96fc60ed7a. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b19462-01cf-4d63-af85-9466965fd36a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:00 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD Sep 03 13:36:00 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:00 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac" returned: 0 in 0.529s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:00 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac Sep 03 13:36:00 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (36cf70bc-4b83-42a3-a5e2-f7006ed8d091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a7b7d0-6f27-4018-b569-f134e678099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a7b7d0-6f27-4018-b569-f134e678099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1093554620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edcb05e-2a10-446e-8d48-80af5db5fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:00Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:00 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65550d63-dabc-4285-a740-d0cbc5ff67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65550d63-dabc-4285-a740-d0cbc5ff67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13cf63d-fd33-4d80-8304-da6727dedb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13cf63d-fd33-4d80-8304-da6727dedb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0edcb05e-2a10-446e-8d48-80af5db5fc59', 'volume_name': 'volume-0edcb05e-2a10-446e-8d48-80af5db5fc59', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b038bd-d5c5-412a-9e82-b8495dbfb2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b038bd-d5c5-412a-9e82-b8495dbfb2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76609171-66a7-4f61-8f67-8c7614597dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:00 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Volume 0edcb05e-2a10-446e-8d48-80af5db5fc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0edcb05e-2a10-446e-8d48-80af5db5fc59', 'volume_size': 1} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1093554620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edcb05e-2a10-446e-8d48-80af5db5fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:00Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Creating volume 0edcb05e-2a10-446e-8d48-80af5db5fc59 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:00 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:00 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 1073741824 Sep 03 13:36:00 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:00 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e.1405b06e-2d64-4a18-9ef0-5b85298038ac" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-1405b06e-2d64-4a18-9ef0-5b85298038ac" released by "_delete_snapshot" :: held 2.162s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" released by "delete_snapshot" :: held 2.195s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Deleting offline snapshot 64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 of volume d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] snapshot_file for this snap is: volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc359650-4061-4330-bad4-ecdd24fbee2a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:00 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 Sep 03 13:36:00 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:01 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 1073741824" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:01 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 Sep 03 13:36:01 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:01 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29da240-8826-4a87-bdad-412dd97cc297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b3c18a-7a68-4790-a508-7e39f6bc61b4]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:01 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 Sep 03 13:36:01 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:01 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1112253568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00319b63-998c-45ef-a17f-4b08014f32c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d43b7ea999d46218b45400b83ba8a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:35:58Z,use_quota=True,user_id='d2cec280771e4c83b8acbb96fc60ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Creating volume 00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:01 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76609171-66a7-4f61-8f67-8c7614597dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0edcb05e-2a10-446e-8d48-80af5db5fc59', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:01 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1073741824 Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b468bbc-1379-4482-a7b7-5a3ecf413a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:01 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:01 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Volume volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 (0edcb05e-2a10-446e-8d48-80af5db5fc59): created successfully Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b468bbc-1379-4482-a7b7-5a3ecf413a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (36cf70bc-4b83-42a3-a5e2-f7006ed8d091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-396a7c5d-c68f-469c-b330-f7f7f5f21555 tempest-AttachVolumeNegativeTest-1824734433 None] Created volume successfully. Sep 03 13:36:01 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:01 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 Sep 03 13:36:01 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:01 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1073741824" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:01 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 Sep 03 13:36:01 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:02 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:02 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317 Sep 03 13:36:02 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:02 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Attempting download of 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 00319b63-998c-45ef-a17f-4b08014f32c3. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbea5a8-0590-40c6-8868-6a89614891e5]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_ {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:02 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297.64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-64bdb014-1fd3-4f7e-b5f0-1b0e3a72e317" released by "_delete_snapshot" :: held 1.608s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" released by "delete_snapshot" :: held 1.635s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:02 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_ Sep 03 13:36:02 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:02 devstack cinder-volume[86933]: WARNING cinder.quota [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-608559354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-608559354, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:02 devstack cinder-volume[86933]: WARNING cinder.quota [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-608559354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-608559354, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['1043a14b-0d2b-439e-8051-f82176220e9a', 'feb27347-7db7-4ca6-bc96-c44c580a5a58', 'a6d2e508-a73a-4196-be0e-0e1c130f623c', 'bb98c65c-572f-4433-afeb-436942d6f44f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['c24ec415-4135-42fc-a446-9d74b4290cb5', '66f72ee2-4abf-4c86-840f-b8dc58158691', 'c76bc069-88ed-48df-9599-b4a903d09a49', 'df8b1b18-1c5d-4000-9a9d-760788878270'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:02 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_" returned: 0 in 0.391s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_ {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fa29be68-fe8b-481d-a01e-a745d7197a19 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 725eca89-3fc9-43dd-876b-89e935eee4ba: deleted successfully Sep 03 13:36:02 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_ Sep 03 13:36:02 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:03 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_" returned: 1 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_iziioku_' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3a97f-3631-472d-bf6d-02ca1c6dc9ee]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:03 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD Sep 03 13:36:03 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1ff0c8c0-0f66-49e2-bc51-297bd88f2382 req-661e4f38-47e8-470c-ad9c-97a8243ece0c tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1ff0c8c0-0f66-49e2-bc51-297bd88f2382 req-661e4f38-47e8-470c-ad9c-97a8243ece0c tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:03 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-1ff0c8c0-0f66-49e2-bc51-297bd88f2382 req-661e4f38-47e8-470c-ad9c-97a8243ece0c tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:03 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 Sep 03 13:36:03 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-1ff0c8c0-0f66-49e2-bc51-297bd88f2382 req-661e4f38-47e8-470c-ad9c-97a8243ece0c tempest-AttachVolumeNegativeTest-1824734433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-0edcb05e-2a10-446e-8d48-80af5db5fc59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '469811e1-d3c5-4693-a3f0-8ac8cedad233', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd1269e-0c36-4643-9722-d6f38a77361e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:03 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-1ff0c8c0-0f66-49e2-bc51-297bd88f2382 req-661e4f38-47e8-470c-ad9c-97a8243ece0c tempest-AttachVolumeNegativeTest-1824734433 None] attachment_update completed successfully. Sep 03 13:36:03 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e Sep 03 13:36:03 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:04 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" returned: 0 in 0.491s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:04 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e Sep 03 13:36:04 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:04 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-2b43e40b-0870-4b30-a4ac-8a99d9506d3e" released by "delete_volume" :: held 0.968s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c785e4f-0100-4563-abcf-33ea7abc514c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:04 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 Sep 03 13:36:04 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:05 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297" returned: 0 in 0.523s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:05 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297 Sep 03 13:36:05 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:05 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d29da240-8826-4a87-bdad-412dd97cc297" returned: 0 in 0.326s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d29da240-8826-4a87-bdad-412dd97cc297" released by "delete_volume" :: held 0.938s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['2cf1d2d1-5e19-4cf5-98ba-8aafcd88a2fc'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:05 devstack cinder-volume[86933]: WARNING cinder.quota [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-608559354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-608559354, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['e0bfae22-5727-4d18-8fb4-35176d5f7ef8', 'c27a4bad-be13-4ce0-b84c-a032005a716a', 'e4d9ac78-bc02-4c71-8891-4bf83006ee6e', 'e270658c-26e4-4274-bb2f-f726916106ea'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:05 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3" returned: 0 in 2.259s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_665d4qdndevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:36:05 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Converted 112.00 MB image at 49.56 MB/s Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:05 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1G Sep 03 13:36:05 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['21fe8d29-09ff-4b21-9a3d-e2f224795392', '27a6ef1d-9e40-48f1-88a3-1ab3eca77446', '3865a2d4-9938-4ade-adfa-46f08fa3daea', '4424cd53-e85f-4486-85d2-6c1beae1945a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:06 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:06 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:06 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 1G" returned: 0 in 0.563s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Downloaded image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 00319b63-998c-45ef-a17f-4b08014f32c3 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 for user d2cec280771e4c83b8acbb96fc60ed7a is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Marking volume 00319b63-998c-45ef-a17f-4b08014f32c3 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Copying metadata from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 to 00319b63-998c-45ef-a17f-4b08014f32c3. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Creating volume glance metadata for volume 00319b63-998c-45ef-a17f-4b08014f32c3 backed by image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543b2b2b-6ef4-474f-9868-e00479fdee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00319b63-998c-45ef-a17f-4b08014f32c3', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fd18ec-66a7-4c7a-a601-9988819a3db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Volume volume-00319b63-998c-45ef-a17f-4b08014f32c3 (00319b63-998c-45ef-a17f-4b08014f32c3): created successfully Sep 03 13:36:06 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fd18ec-66a7-4c7a-a601-9988819a3db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Flow 'volume_create_manager' (ba2c6cf8-428b-42a8-a07e-b3aaa5b5ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.489s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:06 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b7a76e43-85e1-45f6-8d51-32eb06f63e4d tempest-GroupSnapshotsTest-1737489660 None] Delete group completed successfully. Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-574ab0f9-b58a-493b-8dba-acba0eae5d05 tempest-VolumesImageMetadata-780800516 None] Created volume successfully. Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5cea38fe-e93f-4a60-862a-a89cdfeb17cc tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-1735944689: creating Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5cea38fe-e93f-4a60-862a-a89cdfeb17cc tempest-GroupSnapshotsTest-1737489660 None] Group tempest-GroupSnapshotsTest-Group-1735944689: created successfully Sep 03 13:36:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5cea38fe-e93f-4a60-862a-a89cdfeb17cc tempest-GroupSnapshotsTest-1737489660 None] Create group completed successfully. Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Acquiring lock "cinder-00319b63-998c-45ef-a17f-4b08014f32c3-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "cinder-00319b63-998c-45ef-a17f-4b08014f32c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Acquiring lock "cinder-quobyte-00319b63-998c-45ef-a17f-4b08014f32c3" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "cinder-quobyte-00319b63-998c-45ef-a17f-4b08014f32c3" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10687445-97a0-4e63-b788-e1e06ba43148]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:07 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 Sep 03 13:36:07 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:07 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:07 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3 Sep 03 13:36:07 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:08 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00319b63-998c-45ef-a17f-4b08014f32c3" returned: 0 in 0.382s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "cinder-quobyte-00319b63-998c-45ef-a17f-4b08014f32c3" released by "delete_volume" :: held 0.860s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Created reservations ['38e5b0b2-909a-47e4-a03c-1e663b444f3e', '1b1c5391-06cd-4924-85c7-92fb008304e3', 'c2a99ccd-8d65-4b56-9faf-3e64d175c873', '0c0d309a-b12f-4a92-9870-43f1818ebd59'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:08 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:08 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (c3679c8a-50f2-4ea7-adc3-a423d6791df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d34a5bb-12dc-46ae-ab24-ead8565bc7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:08 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.381s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d34a5bb-12dc-46ae-ab24-ead8565bc7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b7679d8-efc7-4536-9546-cac803c7e0ba,host='devstack@QuobyteHD#QuobyteHD',id=d86c6a6b-f898-4eab-86cc-598cd4a3cf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:09Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d135a7-f890-4653-bfea-e95841f08962),volume_type_id=f3d135a7-f890-4653-bfea-e95841f08962)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade76f5d-f5cb-48c8-bc0c-90f7c8191050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade76f5d-f5cb-48c8-bc0c-90f7c8191050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58da2a7a-ff70-4a01-8312-93749e12fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58da2a7a-ff70-4a01-8312-93749e12fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86c6a6b-f898-4eab-86cc-598cd4a3cf76', 'volume_name': 'volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7527af-3cab-4419-81b6-05aa032c75f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7527af-3cab-4419-81b6-05aa032c75f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae490d1-aa17-444b-90e4-c0217ebda529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:08 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Volume d86c6a6b-f898-4eab-86cc-598cd4a3cf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76', 'volume_size': 1} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b7679d8-efc7-4536-9546-cac803c7e0ba,created_at=2026-09-03T11:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b7679d8-efc7-4536-9546-cac803c7e0ba,host='devstack@QuobyteHD#QuobyteHD',id=d86c6a6b-f898-4eab-86cc-598cd4a3cf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f33556406ae4effab69165181f68fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:09Z,use_quota=True,user_id='95aba73d524647c18d2270969d9ac8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d135a7-f890-4653-bfea-e95841f08962),volume_type_id=f3d135a7-f890-4653-bfea-e95841f08962)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Creating volume d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:08 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Deleted volume successfully. Sep 03 13:36:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-516cbb97-18ee-434c-8775-21d83e4acb74 tempest-VolumesImageMetadata-780800516 None] Lock "cinder-00319b63-998c-45ef-a17f-4b08014f32c3-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:08 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 1073741824 Sep 03 13:36:08 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:09 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 1073741824" returned: 0 in 0.614s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:09 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 Sep 03 13:36:09 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:10 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" returned: 0 in 0.505s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae490d1-aa17-444b-90e4-c0217ebda529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a556ae-70ad-48e0-a404-50ccd9f67ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Volume volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 (d86c6a6b-f898-4eab-86cc-598cd4a3cf76): created successfully Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a556ae-70ad-48e0-a404-50ccd9f67ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Flow 'volume_create_manager' (c3679c8a-50f2-4ea7-adc3-a423d6791df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fc5e44f5-9703-4765-933e-3f9b2d7a6943 tempest-GroupSnapshotsTest-1737489660 None] Created volume successfully. Sep 03 13:36:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] GroupSnapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: creating. Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Group snapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: creating. {{(pid=86933) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Creating offline snapshot 99e7247a-09b9-4647-8e12-448873068ac4 of volume d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09e0f0-ae73-4913-9536-ac4fe5dcba06]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:11 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 Sep 03 13:36:11 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:12 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" returned: 0 in 0.664s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:12 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 1G Sep 03 13:36:12 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:13 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 1G" returned: 0 in 0.762s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:13 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 Sep 03 13:36:13 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:13 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4" returned: 0 in 0.372s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:13 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:13 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 Sep 03 13:36:13 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:13 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4" returned: 0 in 0.395s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:13 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info Sep 03 13:36:13 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:14 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:14 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:36:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:14 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info Sep 03 13:36:14 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:14 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.info" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8e5ebc29-0778-4ce6-a54e-8f77e0270bed tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: created successfully Sep 03 13:36:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: deleting Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: deleting {{(pid=86933) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Flow 'volume_create_manager' (dc1e9f48-4927-43d5-b303-04a622dc7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5905fa-a968-4693-bdc3-f7f95666f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5905fa-a968-4693-bdc3-f7f95666f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1983189228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2822cd-f824-47c7-b9c3-b88f96de3a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8215564b8284cdebcd0acccba06976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:15Z,use_quota=True,user_id='d127dd84b9594162b359f088d4f95a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cba63a-60b0-47fc-978b-5a2e95fb7dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cba63a-60b0-47fc-978b-5a2e95fb7dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1911083a-afd8-40ce-ba13-8febdbf978c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1911083a-afd8-40ce-ba13-8febdbf978c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2822cd-f824-47c7-b9c3-b88f96de3a9a', 'volume_name': 'volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3128c46-aedc-47ae-b168-821a3e7e25b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3128c46-aedc-47ae-b168-821a3e7e25b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa59a342-c073-4d2f-a0fb-2bae6daece93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:15 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Volume 0f2822cd-f824-47c7-b9c3-b88f96de3a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a', 'volume_size': 1} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1983189228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2822cd-f824-47c7-b9c3-b88f96de3a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8215564b8284cdebcd0acccba06976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:15Z,use_quota=True,user_id='d127dd84b9594162b359f088d4f95a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Creating volume 0f2822cd-f824-47c7-b9c3-b88f96de3a9a {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:15 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:15 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a 1073741824 Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-99e7247a-09b9-4647-8e12-448873068ac4" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:15 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-99e7247a-09b9-4647-8e12-448873068ac4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Deleting offline snapshot 99e7247a-09b9-4647-8e12-448873068ac4 of volume d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] snapshot_file for this snap is: volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[92119cc3-b184-4972-89e1-0423a43177e1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:15 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 Sep 03 13:36:15 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:16 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a 1073741824" returned: 0 in 0.671s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:16 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4" returned: 0 in 0.500s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8d605-5dbf-4f98-9056-3319ad4a8dc8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:16 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a Sep 03 13:36:16 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:16 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 Sep 03 13:36:16 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:16 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" returned: 0 in 0.411s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa59a342-c073-4d2f-a0fb-2bae6daece93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff779fda-7825-47a9-ac5f-7df17388e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:16 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Volume volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a (0f2822cd-f824-47c7-b9c3-b88f96de3a9a): created successfully Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff779fda-7825-47a9-ac5f-7df17388e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Flow 'volume_create_manager' (dc1e9f48-4927-43d5-b303-04a622dc7d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-00375c3c-b253-4904-9e80-7cd042841b54 tempest-VolumesTransfersTest-611777332 None] Created volume successfully. Sep 03 13:36:16 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" returned: 0 in 0.735s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:16 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 Sep 03 13:36:16 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:17 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4" returned: 0 in 0.619s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:17 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4 Sep 03 13:36:17 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:17 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76.99e7247a-09b9-4647-8e12-448873068ac4" returned: 0 in 0.552s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-99e7247a-09b9-4647-8e12-448873068ac4" released by "_delete_snapshot" :: held 2.627s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" released by "delete_snapshot" :: held 2.684s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:18 devstack cinder-volume[86933]: WARNING cinder.quota [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1740462514 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1740462514, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:18 devstack cinder-volume[86933]: WARNING cinder.quota [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1740462514 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1740462514, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:18 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['dfacc477-f8bf-485c-a501-04c1357fba37', 'f616ea73-3df8-4ee4-b87a-d8c4591fd485', 'eec4862b-a9fe-4bc7-abe8-7cfdc43e706a', '31cce0ea-c66e-4e4c-b95d-6ea029dc627a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d3934703-ce21-4c29-925c-59370011ee06 tempest-GroupSnapshotsTest-1737489660 None] group_snapshot 6094dda4-907d-4c22-b1a7-eafccf70b1d0: deleted successfully Sep 03 13:36:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-db35ee19-b950-476a-9143-acc956982bb8 tempest-VolumesTransfersTest-2093186761 None] Transfer volume completed successfully. Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "cinder-0f2822cd-f824-47c7-b9c3-b88f96de3a9a-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-0f2822cd-f824-47c7-b9c3-b88f96de3a9a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" acquired by "delete_volume" :: waited 0.073s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea73a2a6-85e6-4bcb-9f96-77ce915b6fa5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "cinder-quobyte-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-quobyte-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" acquired by "delete_volume" :: waited 0.084s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634edfa-126b-493a-9791-0b80a2f3bc36]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:20 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 Sep 03 13:36:20 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:20 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a Sep 03 13:36:20 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:20 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" returned: 0 in 0.632s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:20 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a Sep 03 13:36:20 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:20 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" returned: 0 in 1.010s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:20 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76 Sep 03 13:36:20 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:21 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" returned: 0 in 0.503s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Lock "cinder-quobyte-d86c6a6b-f898-4eab-86cc-598cd4a3cf76" released by "delete_volume" :: held 1.638s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:21 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" returned: 0 in 0.684s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-quobyte-0f2822cd-f824-47c7-b9c3-b88f96de3a9a" released by "delete_volume" :: held 1.408s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['1c976c95-d2a3-45d7-aba0-cff73b7abd2b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Created reservations ['9cd31e0b-b04c-4560-a0de-78b0a8440a61', '7223e777-b866-4506-b38f-4cd2bc9d9d7f', '4d6d791f-0fa3-439f-bd04-4283a42261f5', '10e2faad-0e47-4543-bd12-d9f558cf4712'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:21 devstack cinder-volume[86933]: WARNING cinder.quota [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1740462514 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1740462514, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Created reservations ['13f4747c-3474-499b-a9a7-27eeb6e16411', '25eca69f-f84a-43cc-93f7-1bc34de2dd2e', 'c8be9b24-94cc-4d91-ab47-60f3f716ec80', 'a21cf763-c188-4c6f-8ff0-f3a0a42fd512'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:21 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:21 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:21 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:21 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:22 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.487s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:22 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Deleted volume successfully. Sep 03 13:36:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0bfa356e-e078-45fe-933c-2b6bb87434e8 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-0f2822cd-f824-47c7-b9c3-b88f96de3a9a-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:22 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.670s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:22 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-95f25326-f6fe-40d7-9f03-0443fb377911 tempest-GroupSnapshotsTest-1737489660 None] Delete group completed successfully. Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Flow 'volume_create_manager' (7319d713-3a47-4926-9b9c-2fd5779de68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f59b9-696f-4438-b4af-a3cf89318aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f59b9-696f-4438-b4af-a3cf89318aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888155176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbcde49-6023-422c-ad0b-71860a7a5c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8215564b8284cdebcd0acccba06976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:24Z,use_quota=True,user_id='d127dd84b9594162b359f088d4f95a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c942015-08b1-4f4c-a304-70cc2b9b702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c942015-08b1-4f4c-a304-70cc2b9b702b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb22c60-980e-462d-b857-2128c5087b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb22c60-980e-462d-b857-2128c5087b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbcde49-6023-422c-ad0b-71860a7a5c3b', 'volume_name': 'volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee550c-feac-4f85-83a1-108cb5830583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee550c-feac-4f85-83a1-108cb5830583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f0e145-8383-429a-9f89-d832fce3c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:23 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Volume 2bbcde49-6023-422c-ad0b-71860a7a5c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b', 'volume_size': 1} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888155176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbcde49-6023-422c-ad0b-71860a7a5c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8215564b8284cdebcd0acccba06976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:24Z,use_quota=True,user_id='d127dd84b9594162b359f088d4f95a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Creating volume 2bbcde49-6023-422c-ad0b-71860a7a5c3b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:23 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:23 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b 1073741824 Sep 03 13:36:23 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:24 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b 1073741824" returned: 0 in 0.862s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:24 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b Sep 03 13:36:24 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:25 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b" returned: 0 in 0.528s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f0e145-8383-429a-9f89-d832fce3c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c240e1c-02ba-48de-9691-53d24849ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:25 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Volume volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b (2bbcde49-6023-422c-ad0b-71860a7a5c3b): created successfully Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c240e1c-02ba-48de-9691-53d24849ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Flow 'volume_create_manager' (7319d713-3a47-4926-9b9c-2fd5779de68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-21f922fa-bf01-4f35-92ba-0c79fe6f3d0c tempest-VolumesTransfersTest-611777332 None] Created volume successfully. Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "cinder-2bbcde49-6023-422c-ad0b-71860a7a5c3b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-2bbcde49-6023-422c-ad0b-71860a7a5c3b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "cinder-quobyte-2bbcde49-6023-422c-ad0b-71860a7a5c3b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-quobyte-2bbcde49-6023-422c-ad0b-71860a7a5c3b" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[437dac24-5deb-478d-a879-ad192b978230]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:27 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b Sep 03 13:36:27 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:27 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b" returned: 0 in 0.550s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:27 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b Sep 03 13:36:27 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:27 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2bbcde49-6023-422c-ad0b-71860a7a5c3b" returned: 0 in 0.389s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-quobyte-2bbcde49-6023-422c-ad0b-71860a7a5c3b" released by "delete_volume" :: held 1.057s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:27 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Created reservations ['0b48468b-dba6-496a-992f-f5ac6026bf10', '01bf22e2-f09d-4334-934a-4f0cc4843421', 'bdf950ed-2042-4639-a9ac-0bac63694dc4', 'cbbb53df-1136-4f14-8d5d-14870405f55a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:28 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:28 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:28 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Deleted volume successfully. Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=187,cinder:UPDATE=197,cinder:INSERT=44,cinder:DELETE=6 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:36:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fe4706ff-fe8f-4762-bd90-77c95696b0c5 tempest-VolumesTransfersTest-1759507623 None] Lock "cinder-2bbcde49-6023-422c-ad0b-71860a7a5c3b-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:33 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:33 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:34 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.526s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:36:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:36:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:36:38 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=198,cinder:INSERT=60,cinder:SELECT=162,cinder:DELETE=14 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Flow 'volume_create_manager' (2c711fea-8871-4c74-b737-8acebca5c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f9f079-9b34-468c-a6a5-69a6e894ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f9f079-9b34-468c-a6a5-69a6e894ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-415735153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609b301432449cd9169d4fbe3b85256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:39Z,use_quota=True,user_id='7a7cdfb76f2c4c97bb909c75a2185914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0d539e-ec9d-476c-b680-85820e10cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0d539e-ec9d-476c-b680-85820e10cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320c3fa-c271-4b06-b453-c7425553d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:39 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320c3fa-c271-4b06-b453-c7425553d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e', 'volume_name': 'volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b01d0-24e3-470a-9b58-b1bd87c30d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b01d0-24e3-470a-9b58-b1bd87c30d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a75e3d-f6b3-4e57-b9f6-22bddbca0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Trying to clone 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:36:40 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Image download 20.69 MB at 20.69 MB/s Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd40255-eef8-4c22-a768-e9447574643c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:40 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD Sep 03 13:36:40 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4c9c7285-68ff-4a6b-83c6-4510ef3e8533 tempest-GroupsTest-415950433 None] Group tempest-Group1-719120025: creating Sep 03 13:36:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4c9c7285-68ff-4a6b-83c6-4510ef3e8533 tempest-GroupsTest-415950433 None] Group tempest-Group1-719120025: created successfully Sep 03 13:36:41 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:41 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 is fetched for user 7a7cdfb76f2c4c97bb909c75a2185914. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:36:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4c9c7285-68ff-4a6b-83c6-4510ef3e8533 tempest-GroupsTest-415950433 None] Create group completed successfully. Sep 03 13:36:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e5689-44a6-4a94-835d-b2a046790cc0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:41 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD Sep 03 13:36:41 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:42 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-415735153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609b301432449cd9169d4fbe3b85256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:39Z,use_quota=True,user_id='7a7cdfb76f2c4c97bb909c75a2185914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Creating volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:42 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:42 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1073741824 Sep 03 13:36:42 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-98690e6b-e188-4418-b7f2-28486b05feca tempest-GroupsTest-415950433 None] Group tempest-Group2-333658569: creating Sep 03 13:36:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-98690e6b-e188-4418-b7f2-28486b05feca tempest-GroupsTest-415950433 None] Group tempest-Group2-333658569: created successfully Sep 03 13:36:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-98690e6b-e188-4418-b7f2-28486b05feca tempest-GroupsTest-415950433 None] Create group completed successfully. Sep 03 13:36:42 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1073741824" returned: 0 in 0.595s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:42 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e Sep 03 13:36:42 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:43 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Attempting download of 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16097b-07b5-491c-904b-c2d7fdd3091a]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:43 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64 Sep 03 13:36:43 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:43 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64" returned: 0 in 0.361s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:43 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64 Sep 03 13:36:43 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:44 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64" returned: 1 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_gvzrea64' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:36:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a735eeb7-e3b4-4a64-aa16-4bfdb4b55c3d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:44 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD Sep 03 13:36:44 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (8a12e402-49ee-4306-8098-565b95ac550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0951f8-b142-46ca-ae26-bc728b764359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0951f8-b142-46ca-ae26-bc728b764359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-33475844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db3a133a-9612-4995-885d-f10ce25489fc,host='devstack@QuobyteHD#QuobyteHD',id=d8f0313c-739e-4d6d-bb5e-3c2774f4ed11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:45Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfa3daae-95a2-438b-9c81-f1bf4a132b88),volume_type_id=dfa3daae-95a2-438b-9c81-f1bf4a132b88)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3925a70-c7aa-4715-b792-423eb8e63b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:45 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3925a70-c7aa-4715-b792-423eb8e63b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aad133b-7ac0-4bb1-bbaf-b13c75def0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aad133b-7ac0-4bb1-bbaf-b13c75def0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f0313c-739e-4d6d-bb5e-3c2774f4ed11', 'volume_name': 'volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d908525-ea33-47b6-94fa-f1214edfed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d908525-ea33-47b6-94fa-f1214edfed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387d5c17-3f5f-4c05-b869-1d444769990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Volume d8f0313c-739e-4d6d-bb5e-3c2774f4ed11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11', 'volume_size': 1} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db3a133a-9612-4995-885d-f10ce25489fc,created_at=2026-09-03T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-33475844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db3a133a-9612-4995-885d-f10ce25489fc,host='devstack@QuobyteHD#QuobyteHD',id=d8f0313c-739e-4d6d-bb5e-3c2774f4ed11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:45Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfa3daae-95a2-438b-9c81-f1bf4a132b88),volume_type_id=dfa3daae-95a2-438b-9c81-f1bf4a132b88)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Creating volume d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:45 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD" returned: 0 in 1.311s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:36:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:45 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 1073741824 Sep 03 13:36:45 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:45 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e Sep 03 13:36:45 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:46 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 1073741824" returned: 0 in 1.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:46 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 Sep 03 13:36:46 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:47 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" returned: 0 in 0.583s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387d5c17-3f5f-4c05-b869-1d444769990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c02d0b3-a0a3-457a-8fb6-9461357f9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Volume volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 (d8f0313c-739e-4d6d-bb5e-3c2774f4ed11): created successfully Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c02d0b3-a0a3-457a-8fb6-9461357f9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (8a12e402-49ee-4306-8098-565b95ac550b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d761d7cc-1709-4f59-baa2-872a3075483f tempest-GroupsTest-415950433 None] Created volume successfully. Sep 03 13:36:49 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" returned: 0 in 4.337s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:49 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_x0dpnouwdevstack@QuobyteHD, size 112.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:36:49 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Converted 112.00 MB image at 25.79 MB/s Sep 03 13:36:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:49 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1G Sep 03 13:36:49 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Acquiring lock "cinder-quobyte-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" acquired by "delete_volume" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d5ec65-c8da-428f-977e-60aa4a4ceaef]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:50 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 Sep 03 13:36:50 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:50 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 1G" returned: 0 in 0.618s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Downloaded image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 for user 7a7cdfb76f2c4c97bb909c75a2185914 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Marking volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Copying metadata from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 to 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Creating volume glance metadata for volume 5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e backed by image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a75e3d-f6b3-4e57-b9f6-22bddbca0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c61814-4d33-4cc8-9e1f-62baa9076d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Volume volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e (5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e): created successfully Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c61814-4d33-4cc8-9e1f-62baa9076d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Flow 'volume_create_manager' (2c711fea-8871-4c74-b737-8acebca5c809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e8ae52f1-5590-4c01-aeb4-348b711a488e tempest-VolumesExtendTest-509902767 None] Created volume successfully. Sep 03 13:36:50 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" returned: 0 in 0.606s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:50 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11 Sep 03 13:36:50 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:51 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-d8f0313c-739e-4d6d-bb5e-3c2774f4ed11" released by "delete_volume" :: held 1.100s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5a1f0-d8cd-4aa4-a7a7-ac0e2b87b7b2]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Created reservations ['ec9c2315-9a9d-4a23-821a-2672808c2334'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:51 devstack cinder-volume[86933]: WARNING cinder.quota [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2071352307 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2071352307, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:51 devstack cinder-volume[86933]: WARNING cinder.quota [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2071352307 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2071352307, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Created reservations ['ebae8c69-22f2-4405-91b2-2e59da845292', '38a551fc-6daa-48f2-9efe-6fab1c5bdb74', '74d926d3-be5a-4718-86af-d55369a914db', 'b8028e91-fffc-4b64-8149-f85f07d0d1b5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:51 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e Sep 03 13:36:51 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:51 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:51 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:52 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:52 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" returned: 0 in 0.775s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 2G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-75f01cea-41c5-4e70-892e-1b0de1421d1b tempest-GroupsTest-415950433 None] Delete group completed successfully. Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e 2G" returned: 0 in 0.143s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.979s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3b057fa7-05c5-42e3-8098-f38ec1187115 tempest-VolumesExtendTest-509902767 None] Extend volume completed successfully. Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "cinder-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-quobyte-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75617fe6-3252-4f9b-bf13-74e4e2669f18]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:52 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e Sep 03 13:36:52 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Created reservations ['cef0f458-0ca7-488e-b9b9-b16c6dbd4458'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:53 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:53 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:53 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:53 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e Sep 03 13:36:53 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:53 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.341s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2d04ea55-fddf-4b31-94a6-24191e829695 tempest-GroupsTest-415950433 None] Delete group completed successfully. Sep 03 13:36:53 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e" released by "delete_volume" :: held 0.846s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Created reservations ['eaf5c2b7-c265-4f1f-8edc-01876d23d5a2', 'a5f933b7-a711-4453-a572-b6dac8fcb4d3', 'bfc3ef3b-1a20-4617-bd2f-64575cb2cc1c', '861b4e82-b1c9-4450-954f-8b72a22ad58e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:53 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:36:53 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:54 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.320s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:36:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Deleted volume successfully. Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b333d47-6836-4e50-b929-b70c552db6ab tempest-VolumesExtendTest-509902767 None] Lock "cinder-5f4c0ec1-f49b-4483-b8b0-de27a3f3b77e-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Flow 'volume_create_manager' (a9acc222-d893-4de2-b63a-aa3107047f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4758788d-f66e-45e8-8546-ca0a43058416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4758788d-f66e-45e8-8546-ca0a43058416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-225063198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac422d8-2f56-4f09-9ca8-ac88900b2518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f6840dc71445409fb3c4aac8ab393d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:54Z,use_quota=True,user_id='d8aa0d839dc04f05a985886ddcdbdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e711f191-d4d9-4201-aa5a-83042733b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e711f191-d4d9-4201-aa5a-83042733b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b442b7-f10d-4096-852a-70f0e9f54838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b442b7-f10d-4096-852a-70f0e9f54838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac422d8-2f56-4f09-9ca8-ac88900b2518', 'volume_name': 'volume-cac422d8-2f56-4f09-9ca8-ac88900b2518', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed1d65-1df9-4119-9687-922e05371059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed1d65-1df9-4119-9687-922e05371059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb7b98-58a5-4191-bdd7-7eb779e9914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Volume cac422d8-2f56-4f09-9ca8-ac88900b2518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac422d8-2f56-4f09-9ca8-ac88900b2518', 'volume_size': 1} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-225063198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac422d8-2f56-4f09-9ca8-ac88900b2518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f6840dc71445409fb3c4aac8ab393d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:54Z,use_quota=True,user_id='d8aa0d839dc04f05a985886ddcdbdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Creating volume cac422d8-2f56-4f09-9ca8-ac88900b2518 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:54 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:54 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 1073741824 Sep 03 13:36:54 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Flow 'volume_create_manager' (c73ae05a-4571-4d21-9737-4e0f16f0f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdea5557-dba4-441f-884f-4c23cd6aa095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdea5557-dba4-441f-884f-4c23cd6aa095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1078728771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a52ad-86f7-4a4a-8e39-6990b6723800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609b301432449cd9169d4fbe3b85256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:55Z,use_quota=True,user_id='7a7cdfb76f2c4c97bb909c75a2185914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce277475-64cd-4465-8325-c2c81621e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce277475-64cd-4465-8325-c2c81621e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46675488-53e9-46d5-855a-e7c9bb1fd65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46675488-53e9-46d5-855a-e7c9bb1fd65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1a52ad-86f7-4a4a-8e39-6990b6723800', 'volume_name': 'volume-de1a52ad-86f7-4a4a-8e39-6990b6723800', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b213f9-7875-468e-85dc-ba1d9ec7c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b213f9-7875-468e-85dc-ba1d9ec7c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969497e6-a28a-427b-83ef-79c8040b6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Volume de1a52ad-86f7-4a4a-8e39-6990b6723800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1a52ad-86f7-4a4a-8e39-6990b6723800', 'volume_size': 1} Sep 03 13:36:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e347101a-6228-43b1-81bb-61e824cb881c tempest-GroupsTest-415950433 None] Group tempest-GroupsTest-Group-436045549: creating Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e347101a-6228-43b1-81bb-61e824cb881c tempest-GroupsTest-415950433 None] Group tempest-GroupsTest-Group-436045549: created successfully Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e347101a-6228-43b1-81bb-61e824cb881c tempest-GroupsTest-415950433 None] Create group completed successfully. Sep 03 13:36:55 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 1073741824" returned: 0 in 0.626s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:55 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 Sep 03 13:36:55 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-cbcf0291-3957-4949-bff2-dbaf708d8231 req-84a277c5-f18f-4701-85da-b4bc99260bd3 tempest-AttachVolumeNegativeTest-1824734433 None] Terminate volume connection completed successfully. Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-cbcf0291-3957-4949-bff2-dbaf708d8231 req-84a277c5-f18f-4701-85da-b4bc99260bd3 tempest-AttachVolumeNegativeTest-1824734433 None] Deleting attachment 469811e1-d3c5-4693-a3f0-8ac8cedad233. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:36:55 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518" returned: 0 in 0.284s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1078728771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a52ad-86f7-4a4a-8e39-6990b6723800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609b301432449cd9169d4fbe3b85256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:55Z,use_quota=True,user_id='7a7cdfb76f2c4c97bb909c75a2185914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Creating volume de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb7b98-58a5-4191-bdd7-7eb779e9914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac422d8-2f56-4f09-9ca8-ac88900b2518', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:55 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 1073741824 Sep 03 13:36:55 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129949fe-6ffc-47a3-862c-7d914d000d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Volume volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 (cac422d8-2f56-4f09-9ca8-ac88900b2518): created successfully Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129949fe-6ffc-47a3-862c-7d914d000d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Flow 'volume_create_manager' (a9acc222-d893-4de2-b63a-aa3107047f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c52ab3b9-6ed0-4f8f-b33b-a54fd408ac72 tempest-ServersNegativeTestJSON-1542789088 None] Created volume successfully. Sep 03 13:36:56 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 1073741824" returned: 0 in 0.536s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:56 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:36:56 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:56 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.392s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969497e6-a28a-427b-83ef-79c8040b6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1a52ad-86f7-4a4a-8e39-6990b6723800', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884c98d3-2f83-439e-8623-ae198fffa6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Volume volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 (de1a52ad-86f7-4a4a-8e39-6990b6723800): created successfully Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884c98d3-2f83-439e-8623-ae198fffa6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Flow 'volume_create_manager' (c73ae05a-4571-4d21-9737-4e0f16f0f665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4696eaa1-a21c-451b-9d23-f45d41c3977f tempest-VolumesExtendTest-509902767 None] Created volume successfully. Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (ce92cb75-951f-4c98-b97e-f79ab2b54b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319d469-77b4-4850-865a-62d5a1066bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319d469-77b4-4850-865a-62d5a1066bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018559820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2863898-c98c-4149-bbf5-1d984705916e,host='devstack@QuobyteHD#QuobyteHD',id=fdb60836-5ded-4b51-ad30-4f930aba55ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:57Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801e15c5-40d7-42a6-a467-927f0576c516),volume_type_id=801e15c5-40d7-42a6-a467-927f0576c516)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3910fa82-1c94-4c5b-9a38-d9ab1286fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3910fa82-1c94-4c5b-9a38-d9ab1286fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4dc4988-5e96-44cc-8918-62febd7fae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4dc4988-5e96-44cc-8918-62febd7fae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb60836-5ded-4b51-ad30-4f930aba55ea', 'volume_name': 'volume-fdb60836-5ded-4b51-ad30-4f930aba55ea', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90189de7-90ef-487b-9745-f47f7e9e7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90189de7-90ef-487b-9745-f47f7e9e7477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b192be8-eeaf-4617-b863-fefe8f9bfcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Volume fdb60836-5ded-4b51-ad30-4f930aba55ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb60836-5ded-4b51-ad30-4f930aba55ea', 'volume_size': 1} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2863898-c98c-4149-bbf5-1d984705916e,created_at=2026-09-03T11:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018559820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2863898-c98c-4149-bbf5-1d984705916e,host='devstack@QuobyteHD#QuobyteHD',id=fdb60836-5ded-4b51-ad30-4f930aba55ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:57Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801e15c5-40d7-42a6-a467-927f0576c516),volume_type_id=801e15c5-40d7-42a6-a467-927f0576c516)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Creating volume fdb60836-5ded-4b51-ad30-4f930aba55ea {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:36:57 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:57 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea 1073741824 Sep 03 13:36:57 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:58 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea 1073741824" returned: 0 in 0.606s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:58 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea Sep 03 13:36:58 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:58 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.961s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b192be8-eeaf-4617-b863-fefe8f9bfcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb60836-5ded-4b51-ad30-4f930aba55ea', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc6d0f-e97c-43c7-868e-6ca77e41d77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Creating offline snapshot ed8fb43f-95e3-4b28-96e3-16d2cca5962e of volume de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:36:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Volume volume-fdb60836-5ded-4b51-ad30-4f930aba55ea (fdb60836-5ded-4b51-ad30-4f930aba55ea): created successfully Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc6d0f-e97c-43c7-868e-6ca77e41d77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (ce92cb75-951f-4c98-b97e-f79ab2b54b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae63180-2614-40ac-b3d3-582a52563f56]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:36:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ec3c4ead-8306-484d-9bcd-100de44d5b8b tempest-GroupsTest-415950433 None] Created volume successfully. Sep 03 13:36:58 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:36:58 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:59 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.467s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:59 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e 1G Sep 03 13:36:59 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Flow 'volume_create_manager' (de83be9a-aa6c-4821-a038-1c814503031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f550af5c-dae1-4ed2-8b86-1cfad003667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f550af5c-dae1-4ed2-8b86-1cfad003667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1589965876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf04b6e4-b152-4043-ad46-527157131fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f6840dc71445409fb3c4aac8ab393d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:59Z,use_quota=True,user_id='d8aa0d839dc04f05a985886ddcdbdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb47c1a-92c0-43ec-b06b-89c921a9d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb47c1a-92c0-43ec-b06b-89c921a9d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f9e72d-5618-4a69-8946-e0ef280ccc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f9e72d-5618-4a69-8946-e0ef280ccc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf04b6e4-b152-4043-ad46-527157131fa7', 'volume_name': 'volume-cf04b6e4-b152-4043-ad46-527157131fa7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d9e5b-7560-4d6e-b0bf-3b85eed9b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d9e5b-7560-4d6e-b0bf-3b85eed9b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e33af2-5853-4993-a8e6-a0bcd3d18dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:36:59 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Volume cf04b6e4-b152-4043-ad46-527157131fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf04b6e4-b152-4043-ad46-527157131fa7', 'volume_size': 1} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:36:59 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e 1G" returned: 0 in 0.414s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:59 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e Sep 03 13:36:59 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:36:59 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e" returned: 0 in 0.340s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:36:59 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e is being set with open permissions: ugo+rw Sep 03 13:36:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:36:59 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e Sep 03 13:36:59 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:00 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:00 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info Sep 03 13:37:00 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:00 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info" returned: 0 in 0.397s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:00 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info is being set with open permissions: ugo+rw Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:00 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info Sep 03 13:37:00 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (9eca1ff8-f022-4ac3-9681-7b1dee61fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd24c76-7029-449b-85a3-6ad8b3dfd17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd24c76-7029-449b-85a3-6ad8b3dfd17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555924685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2863898-c98c-4149-bbf5-1d984705916e,host='devstack@QuobyteHD#QuobyteHD',id=3716e3de-57a9-4eb5-8133-1435403a928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:00Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801e15c5-40d7-42a6-a467-927f0576c516),volume_type_id=801e15c5-40d7-42a6-a467-927f0576c516)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21104101-477f-41f1-bb69-9fde7e4eb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21104101-477f-41f1-bb69-9fde7e4eb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aa22a2-1561-435b-9f81-622027b51026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aa22a2-1561-435b-9f81-622027b51026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3716e3de-57a9-4eb5-8133-1435403a928c', 'volume_name': 'volume-3716e3de-57a9-4eb5-8133-1435403a928c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b23bd4-1417-4af1-92d1-e710b4a11db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b23bd4-1417-4af1-92d1-e710b4a11db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42ab129-2798-446b-a805-c341972dfcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:00 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Volume 3716e3de-57a9-4eb5-8133-1435403a928c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3716e3de-57a9-4eb5-8133-1435403a928c', 'volume_size': 1} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:00 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.info" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1589965876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf04b6e4-b152-4043-ad46-527157131fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f6840dc71445409fb3c4aac8ab393d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:36:59Z,use_quota=True,user_id='d8aa0d839dc04f05a985886ddcdbdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Creating volume cf04b6e4-b152-4043-ad46-527157131fa7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:37:00 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:37:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:00 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 1073741824 Sep 03 13:37:00 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:00 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a40965ba-e3c0-4735-8772-7bcb652fbc6b tempest-VolumesExtendTest-509902767 None] Create snapshot completed successfully Sep 03 13:37:01 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 1073741824" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:01 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 Sep 03 13:37:01 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:01 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2863898-c98c-4149-bbf5-1d984705916e,created_at=2026-09-03T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555924685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2863898-c98c-4149-bbf5-1d984705916e,host='devstack@QuobyteHD#QuobyteHD',id=3716e3de-57a9-4eb5-8133-1435403a928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb3e0a782e4f6796e3418afad3439f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:00Z,use_quota=True,user_id='83b7a95b095c4f4b8eb0e87dc593ff0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801e15c5-40d7-42a6-a467-927f0576c516),volume_type_id=801e15c5-40d7-42a6-a467-927f0576c516)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Creating volume 3716e3de-57a9-4eb5-8133-1435403a928c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:37:01 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e33af2-5853-4993-a8e6-a0bcd3d18dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf04b6e4-b152-4043-ad46-527157131fa7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8a23c8-fa18-4ede-93cf-1493e388f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:01 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c 1073741824 Sep 03 13:37:01 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:01 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Volume volume-cf04b6e4-b152-4043-ad46-527157131fa7 (cf04b6e4-b152-4043-ad46-527157131fa7): created successfully Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8a23c8-fa18-4ede-93cf-1493e388f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Flow 'volume_create_manager' (de83be9a-aa6c-4821-a038-1c814503031d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-91f9d804-77cc-4ba9-bd6d-6208a265907f tempest-ServersNegativeTestJSON-1542789088 None] Created volume successfully. Sep 03 13:37:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:02 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c 1073741824" returned: 0 in 0.514s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:02 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c Sep 03 13:37:02 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:02 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.653s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42ab129-2798-446b-a805-c341972dfcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3716e3de-57a9-4eb5-8133-1435403a928c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c38f40-8ec2-46f9-9e4b-2e42019def6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88e8ee-338b-462d-a014-0595ef464d12]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:02 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Volume volume-3716e3de-57a9-4eb5-8133-1435403a928c (3716e3de-57a9-4eb5-8133-1435403a928c): created successfully Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c38f40-8ec2-46f9-9e4b-2e42019def6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Flow 'volume_create_manager' (9eca1ff8-f022-4ac3-9681-7b1dee61fcad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0dc1fd58-951e-464a-8eda-c6becee0e1ad tempest-GroupsTest-415950433 None] Created volume successfully. Sep 03 13:37:02 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:37:02 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "cinder-cf04b6e4-b152-4043-ad46-527157131fa7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-cf04b6e4-b152-4043-ad46-527157131fa7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "cinder-quobyte-cf04b6e4-b152-4043-ad46-527157131fa7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-quobyte-cf04b6e4-b152-4043-ad46-527157131fa7" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48f4c9-33e3-48fb-b80b-c94e8796329d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:02 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e 2G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:03 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 Sep 03 13:37:03 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e 2G" returned: 0 in 0.171s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.712s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:03 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c108ab3c-1010-4f81-bfd7-cc1d68bd3cfd tempest-VolumesExtendTest-509902767 None] Extend volume completed successfully. Sep 03 13:37:03 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-80224c71-7433-4261-ad07-9ec86458444b tempest-GroupsTest-415950433 None] Update group completed successfully. Sep 03 13:37:03 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7" returned: 0 in 0.480s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:03 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7 Sep 03 13:37:03 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:03 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cf04b6e4-b152-4043-ad46-527157131fa7" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-quobyte-cf04b6e4-b152-4043-ad46-527157131fa7" released by "delete_volume" :: held 0.790s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Created reservations ['1e50c205-626a-405c-bebc-39d994ef2dfa', 'f6aed183-8458-4b5e-ab9e-b8b1e5590cd1', 'd5077145-c012-47ad-930f-5fe7cc4908bc', 'bd85c93d-bb83-4add-952d-9b87985b7646'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:03 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:03 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "cinder-cac422d8-2f56-4f09-9ca8-ac88900b2518-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-cac422d8-2f56-4f09-9ca8-ac88900b2518-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:04 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "cinder-quobyte-cac422d8-2f56-4f09-9ca8-ac88900b2518" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.319s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Deleted volume successfully. Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-quobyte-cac422d8-2f56-4f09-9ca8-ac88900b2518" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9073ff15-44cb-4c9d-bd99-430d971732b8 tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-cf04b6e4-b152-4043-ad46-527157131fa7-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1389c-b302-4d2d-8a72-a492192f1f0a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-ed8fb43f-95e3-4b28-96e3-16d2cca5962e-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-ed8fb43f-95e3-4b28-96e3-16d2cca5962e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-quobyte-ed8fb43f-95e3-4b28-96e3-16d2cca5962e" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-ed8fb43f-95e3-4b28-96e3-16d2cca5962e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Deleting offline snapshot ed8fb43f-95e3-4b28-96e3-16d2cca5962e of volume de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] snapshot_file for this snap is: volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:37:04 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 Sep 03 13:37:04 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b9d6c-69f1-475f-b831-964bb18baeb2]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:04 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e Sep 03 13:37:04 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:04 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518" returned: 0 in 0.511s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:04 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518 Sep 03 13:37:04 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e63abdf7-cbcd-437e-85d3-d1cf14dff94b tempest-GroupsTest-415950433 None] Update group completed successfully. Sep 03 13:37:04 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e" returned: 0 in 0.487s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de1a52ad-86f7-4a4a-8e39-6990b6723800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174d9c8-9298-46d5-a83e-bfbb45f7bf22]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:05 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:37:05 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:05 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cac422d8-2f56-4f09-9ca8-ac88900b2518" returned: 0 in 0.329s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-quobyte-cac422d8-2f56-4f09-9ca8-ac88900b2518" released by "delete_volume" :: held 0.904s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Created reservations ['e8d52307-1697-469f-ad20-9ba222f167a7', 'ca49cb49-09ad-4cb8-b646-d98e30de64c5', '2886c16e-9d24-401d-acf3-4934260216fd', 'df62a67e-3ee3-4bcb-8126-599664263751'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:05 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:05 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:05 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:05 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e Sep 03 13:37:05 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:05 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Deleted volume successfully. Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e635db9-942a-4b95-b7da-316ea92ea9ad tempest-ServersNegativeTestJSON-1542789088 None] Lock "cinder-cac422d8-2f56-4f09-9ca8-ac88900b2518-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:05 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e" returned: 0 in 0.463s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:05 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e Sep 03 13:37:05 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:06 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800.ed8fb43f-95e3-4b28-96e3-16d2cca5962e" returned: 0 in 0.322s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-ed8fb43f-95e3-4b28-96e3-16d2cca5962e" released by "_delete_snapshot" :: held 1.889s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" released by "delete_snapshot" :: held 1.935s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:06 devstack cinder-volume[86933]: WARNING cinder.quota [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Created reservations ['a8377411-73c9-4267-b440-a4eb0c488a43', 'eab725e4-c948-4696-9fb6-fb573eb380ef', 'c93a0823-3345-42bf-b4ba-615fc00bc95d', '9e4f2aeb-4e2a-4e17-bd60-589e68230a77'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Delete snapshot completed successfully. Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db2625a2-0f50-4cf2-a024-7172728ec0be tempest-VolumesExtendTest-509902767 None] Lock "cinder-ed8fb43f-95e3-4b28-96e3-16d2cca5962e-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Acquiring lock "cinder-quobyte-3716e3de-57a9-4eb5-8133-1435403a928c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-3716e3de-57a9-4eb5-8133-1435403a928c" acquired by "delete_volume" :: waited 0.043s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[66380550-6175-405b-8b12-8f14f0ddbe3b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:06 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c Sep 03 13:37:06 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:07 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c" returned: 0 in 0.728s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:07 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c Sep 03 13:37:07 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-de1a52ad-86f7-4a4a-8e39-6990b6723800-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "cinder-de1a52ad-86f7-4a4a-8e39-6990b6723800-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Acquiring lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd66044-fdce-409f-b9c0-63b1a942d20d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:07 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3716e3de-57a9-4eb5-8133-1435403a928c" returned: 0 in 0.488s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-3716e3de-57a9-4eb5-8133-1435403a928c" released by "delete_volume" :: held 1.285s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Acquiring lock "cinder-quobyte-fdb60836-5ded-4b51-ad30-4f930aba55ea" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:07 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:37:07 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-fdb60836-5ded-4b51-ad30-4f930aba55ea" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[447be747-1cd7-42ae-a27f-8e0d7217814e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:08 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea Sep 03 13:37:08 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:08 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.581s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:08 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800 Sep 03 13:37:08 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:08 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea" returned: 0 in 0.566s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:08 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea Sep 03 13:37:08 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:08 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de1a52ad-86f7-4a4a-8e39-6990b6723800" returned: 0 in 0.465s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "cinder-quobyte-de1a52ad-86f7-4a4a-8e39-6990b6723800" released by "delete_volume" :: held 1.156s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:08 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Created reservations ['bfd80065-43d0-4415-89ab-bfa748864a28', 'd4262059-9967-4881-88c7-7ec51cf19b13', 'fcc319a5-d1fd-4758-894e-1aa38f7c3b44', 'b35043e2-aeab-4e14-9163-fbd380d64001'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:09 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fdb60836-5ded-4b51-ad30-4f930aba55ea" returned: 0 in 0.464s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "cinder-quobyte-fdb60836-5ded-4b51-ad30-4f930aba55ea" released by "delete_volume" :: held 1.105s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:09 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:09 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Created reservations ['9284ab16-ea26-4401-ae6b-d3344438c694'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:09 devstack cinder-volume[86933]: WARNING cinder.quota [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-418963060 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-418963060, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:37:09 devstack cinder-volume[86933]: WARNING cinder.quota [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-418963060 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-418963060, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Created reservations ['fb8f94b5-a8ea-4628-95d0-e9d3e1ef50fd', '2060f039-ccfb-49d2-8e99-56452ba6c9de', 'a81b2e3d-984b-4332-b423-511f83b38b21', '300a2225-877e-4945-b7b6-444fb0172f03'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Created reservations ['d031fe2c-a30d-4885-8c5a-f0513b421081', 'ca3e04cf-f031-4114-b828-c6b2d6033ac7', '18db2128-0ad8-4330-af16-dbb2092225c7', '01faeff7-6c99-4570-9a39-27ccc2411979'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:09 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Deleted volume successfully. Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-afb78be2-dac3-4312-a9d0-005e34617d3f tempest-VolumesExtendTest-509902767 None] Lock "cinder-de1a52ad-86f7-4a4a-8e39-6990b6723800-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:09 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:09 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:10 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.527s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:10 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a60c19b-7b90-4122-937a-3256b75eeca6 tempest-GroupsTest-415950433 None] Delete group completed successfully. Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Flow 'volume_create_manager' (62872c01-ebf5-434b-a26e-298c37521522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d88a1a-0a37-4214-815d-07dc4e43a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d88a1a-0a37-4214-815d-07dc4e43a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1069673942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45476e45-92af-4545-877e-8b853e389aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd60c3d22b4c48fc809348498638f17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:15Z,use_quota=True,user_id='9d5f6ace42ec4b56ae31449e27ad1c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf513a3-2757-4ea2-917e-93ff3ae07e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf513a3-2757-4ea2-917e-93ff3ae07e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4800b5-e498-4051-85e3-19737c68f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4800b5-e498-4051-85e3-19737c68f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45476e45-92af-4545-877e-8b853e389aeb', 'volume_name': 'volume-45476e45-92af-4545-877e-8b853e389aeb', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee20c102-d6d8-475f-94a0-5345c92adb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee20c102-d6d8-475f-94a0-5345c92adb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec9dc20-60b5-4728-aaa7-1df2d057a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Volume 45476e45-92af-4545-877e-8b853e389aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45476e45-92af-4545-877e-8b853e389aeb', 'volume_size': 1} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1069673942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45476e45-92af-4545-877e-8b853e389aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd60c3d22b4c48fc809348498638f17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:15Z,use_quota=True,user_id='9d5f6ace42ec4b56ae31449e27ad1c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Creating volume 45476e45-92af-4545-877e-8b853e389aeb {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:37:14 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:37:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:15 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb 1073741824 Sep 03 13:37:15 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:15 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb 1073741824" returned: 0 in 0.513s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:15 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb Sep 03 13:37:15 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:16 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb" returned: 0 in 0.467s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec9dc20-60b5-4728-aaa7-1df2d057a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45476e45-92af-4545-877e-8b853e389aeb', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9038f90-2926-4718-9a11-b5b9b644894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:16 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Volume volume-45476e45-92af-4545-877e-8b853e389aeb (45476e45-92af-4545-877e-8b853e389aeb): created successfully Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9038f90-2926-4718-9a11-b5b9b644894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Flow 'volume_create_manager' (62872c01-ebf5-434b-a26e-298c37521522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d5a2576b-ed1a-4323-bcb2-74b9d838485d tempest-VolumesNegativeTest-2767454 None] Created volume successfully. Sep 03 13:37:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9943814f-aa18-4797-ac9c-3724fe2f20f8 tempest-GroupsV320Test-1812374820 None] Group tempest-GroupsV320Test-Group-1416041947: creating Sep 03 13:37:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9943814f-aa18-4797-ac9c-3724fe2f20f8 tempest-GroupsV320Test-1812374820 None] Group tempest-GroupsV320Test-Group-1416041947: created successfully Sep 03 13:37:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9943814f-aa18-4797-ac9c-3724fe2f20f8 tempest-GroupsV320Test-1812374820 None] Create group completed successfully. Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Created reservations ['6145c179-ffb0-4c18-ba09-b46abb3575a3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:23 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:23 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:23 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.405s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:23 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c234e019-5325-46f6-970c-f9213060ee58 tempest-GroupsV320Test-1812374820 None] Delete group completed successfully. Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=105,cinder:SELECT=104,cinder:INSERT=26,cinder:DELETE=5 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=92,cinder:UPDATE=114,cinder:INSERT=32,cinder:DELETE=8 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:33 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:33 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:34 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.519s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:37:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:37:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (a45e2790-50ea-47d9-b812-1293718895aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43a7fb-183d-42b3-9f27-6597a4092a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43a7fb-183d-42b3-9f27-6597a4092a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-688956136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff8022-b89e-4dca-b4c3-2539d9422d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:39Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d80a7-0e8f-46cb-b0d2-75bcae9b0809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d80a7-0e8f-46cb-b0d2-75bcae9b0809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be69d02-9729-4074-89e8-1792a8fe0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be69d02-9729-4074-89e8-1792a8fe0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ff8022-b89e-4dca-b4c3-2539d9422d73', 'volume_name': 'volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665362ce-ac02-4e87-af76-37e49fe8287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665362ce-ac02-4e87-af76-37e49fe8287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2424be75-6ef2-4a2a-bda6-b31c99ea10f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:38 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Volume b7ff8022-b89e-4dca-b4c3-2539d9422d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73', 'volume_size': 1} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-688956136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff8022-b89e-4dca-b4c3-2539d9422d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:39Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Creating volume b7ff8022-b89e-4dca-b4c3-2539d9422d73 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:37:38 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:37:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:38 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 1073741824 Sep 03 13:37:38 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:39 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 1073741824" returned: 0 in 0.595s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:39 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 Sep 03 13:37:39 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:39 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2424be75-6ef2-4a2a-bda6-b31c99ea10f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f7e4ca-5f90-4647-bdfc-7302d47c4f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Volume volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 (b7ff8022-b89e-4dca-b4c3-2539d9422d73): created successfully Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f7e4ca-5f90-4647-bdfc-7302d47c4f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (a45e2790-50ea-47d9-b812-1293718895aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ad0927e6-e7b2-40f5-8b13-586af2a9809d tempest-AttachVolumeNegativeTest-1824734433 None] Created volume successfully. Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Acquiring lock "cinder-45476e45-92af-4545-877e-8b853e389aeb-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "cinder-45476e45-92af-4545-877e-8b853e389aeb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Acquiring lock "cinder-quobyte-45476e45-92af-4545-877e-8b853e389aeb" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "cinder-quobyte-45476e45-92af-4545-877e-8b853e389aeb" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119a0e2-4cc7-41e6-8054-a46617b7b404]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-209ef80f-cf39-4aed-a198-71273f85d6ae req-7fd6a9e6-1989-41d2-8fce-68855d9cf4a1 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-209ef80f-cf39-4aed-a198-71273f85d6ae req-7fd6a9e6-1989-41d2-8fce-68855d9cf4a1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-209ef80f-cf39-4aed-a198-71273f85d6ae req-7fd6a9e6-1989-41d2-8fce-68855d9cf4a1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-209ef80f-cf39-4aed-a198-71273f85d6ae req-7fd6a9e6-1989-41d2-8fce-68855d9cf4a1 tempest-AttachVolumeNegativeTest-1824734433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a0add71-e9b1-4a8e-ad04-cfe7af17e86e', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:37:41 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb Sep 03 13:37:41 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-209ef80f-cf39-4aed-a198-71273f85d6ae req-7fd6a9e6-1989-41d2-8fce-68855d9cf4a1 tempest-AttachVolumeNegativeTest-1824734433 None] attachment_update completed successfully. Sep 03 13:37:42 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb" returned: 0 in 0.576s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:42 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb Sep 03 13:37:42 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:42 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-45476e45-92af-4545-877e-8b853e389aeb" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "cinder-quobyte-45476e45-92af-4545-877e-8b853e389aeb" released by "delete_volume" :: held 1.085s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Created reservations ['fb732151-5410-4410-81d4-a6e48359787d', '1a77b3df-7217-4fbe-af9d-32494256eaa2', 'a200af87-9553-457c-8073-216be4f6b120', 'ecf3fb44-6ff1-4656-bebd-29efbd8ccef9'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:42 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:42 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:43 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Deleted volume successfully. Sep 03 13:37:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-703f15b7-9b72-4539-b300-82f3cd5a9c4e tempest-VolumesNegativeTest-2767454 None] Lock "cinder-45476e45-92af-4545-877e-8b853e389aeb-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-fae266ce-1423-4b55-98ce-adfa5b012148 req-4e909c6a-1248-4fb7-8aad-a4244cf8a5f2 tempest-AttachVolumeNegativeTest-1824734433 None] Terminate volume connection completed successfully. Sep 03 13:37:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-fae266ce-1423-4b55-98ce-adfa5b012148 req-4e909c6a-1248-4fb7-8aad-a4244cf8a5f2 tempest-AttachVolumeNegativeTest-1824734433 None] Deleting attachment 0a0add71-e9b1-4a8e-ad04-cfe7af17e86e. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Flow 'volume_create_manager' (bdb944eb-4169-4082-9bc0-e33844094b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce94a4b-aa04-4c09-af39-40bc82cb67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce94a4b-aa04-4c09-af39-40bc82cb67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1388728303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ced1f0-3072-4962-b2d7-b50e7f09f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bae95ba58f4f7796b8f3d525bde972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:54Z,use_quota=True,user_id='eb291e2081ca4ba88ec14f7f1a9ecb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814e2ceb-8d0e-429a-b7ed-4ef53e0f81d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814e2ceb-8d0e-429a-b7ed-4ef53e0f81d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b219b569-b523-436f-91cb-533b1f44176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b219b569-b523-436f-91cb-533b1f44176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ced1f0-3072-4962-b2d7-b50e7f09f441', 'volume_name': 'volume-90ced1f0-3072-4962-b2d7-b50e7f09f441', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051b31a8-0186-479b-9185-775ac6903e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051b31a8-0186-479b-9185-775ac6903e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f31464-7648-4595-a319-95108a2efedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume 90ced1f0-3072-4962-b2d7-b50e7f09f441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ced1f0-3072-4962-b2d7-b50e7f09f441', 'volume_size': 1} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1388728303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ced1f0-3072-4962-b2d7-b50e7f09f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bae95ba58f4f7796b8f3d525bde972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:37:54Z,use_quota=True,user_id='eb291e2081ca4ba88ec14f7f1a9ecb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Creating volume 90ced1f0-3072-4962-b2d7-b50e7f09f441 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:37:54 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:37:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:54 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 1073741824 Sep 03 13:37:54 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:55 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 1073741824" returned: 0 in 0.639s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:55 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 Sep 03 13:37:55 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:55 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f31464-7648-4595-a319-95108a2efedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ced1f0-3072-4962-b2d7-b50e7f09f441', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f81071b-24f7-4536-b4c1-37535264b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:37:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 (90ced1f0-3072-4962-b2d7-b50e7f09f441): created successfully Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f81071b-24f7-4536-b4c1-37535264b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:37:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Flow 'volume_create_manager' (bdb944eb-4169-4082-9bc0-e33844094b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:37:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-53648b90-60cc-4608-ad50-2c870c2c678a tempest-VolumeQuotasAdminTestJSON-638756912 None] Created volume successfully. Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "cinder-90ced1f0-3072-4962-b2d7-b50e7f09f441-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "cinder-90ced1f0-3072-4962-b2d7-b50e7f09f441-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "cinder-quobyte-90ced1f0-3072-4962-b2d7-b50e7f09f441" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "cinder-quobyte-90ced1f0-3072-4962-b2d7-b50e7f09f441" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb527218-2ce4-44cd-a709-152c97df5cd1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:37:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:57 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 Sep 03 13:37:57 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:57 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441" returned: 0 in 0.709s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:57 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441 Sep 03 13:37:57 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:58 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-90ced1f0-3072-4962-b2d7-b50e7f09f441" returned: 0 in 0.493s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "cinder-quobyte-90ced1f0-3072-4962-b2d7-b50e7f09f441" released by "delete_volume" :: held 1.283s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Created reservations ['8661ceab-0433-427d-ac17-491216101f54', '771d7ba8-a324-4699-a888-c992a178a3b3', '77bc356c-9c88-4718-9965-be791f8b1d4f', '7f230415-0313-46c9-9bb0-ce3302a4d189'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:37:58 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:37:58 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:37:58 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.605s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:37:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Deleted volume successfully. Sep 03 13:37:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-db807306-3ab4-45e0-803a-84c693c77da1 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "cinder-90ced1f0-3072-4962-b2d7-b50e7f09f441-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Flow 'volume_create_manager' (92809773-7a13-476b-bfe5-ce03463bf544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71056946-f0f9-440e-8652-7bbc1f0e686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71056946-f0f9-440e-8652-7bbc1f0e686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251116317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25186aca-7b66-49ae-9ff8-7aaadc00edb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bae95ba58f4f7796b8f3d525bde972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:00Z,use_quota=True,user_id='eb291e2081ca4ba88ec14f7f1a9ecb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309bf8d-cad3-40c4-91d1-2908ec9d05e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309bf8d-cad3-40c4-91d1-2908ec9d05e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e8ac6-bcb7-4712-94df-2b18724baee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e8ac6-bcb7-4712-94df-2b18724baee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25186aca-7b66-49ae-9ff8-7aaadc00edb7', 'volume_name': 'volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81464004-3d3a-4629-95fb-0667adfd2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81464004-3d3a-4629-95fb-0667adfd2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31832513-be33-4efa-89a8-124d99f9d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:00 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume 25186aca-7b66-49ae-9ff8-7aaadc00edb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7', 'volume_size': 1} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251116317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25186aca-7b66-49ae-9ff8-7aaadc00edb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bae95ba58f4f7796b8f3d525bde972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:00Z,use_quota=True,user_id='eb291e2081ca4ba88ec14f7f1a9ecb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Creating volume 25186aca-7b66-49ae-9ff8-7aaadc00edb7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:00 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:00 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 1073741824 Sep 03 13:38:00 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:01 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 1073741824" returned: 0 in 0.851s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:01 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 Sep 03 13:38:01 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:01 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7" returned: 0 in 0.319s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31832513-be33-4efa-89a8-124d99f9d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9a0309-5437-4131-ae78-c2df44cf0f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:01 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Volume volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 (25186aca-7b66-49ae-9ff8-7aaadc00edb7): created successfully Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9a0309-5437-4131-ae78-c2df44cf0f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Flow 'volume_create_manager' (92809773-7a13-476b-bfe5-ce03463bf544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8c125bae-05e4-4b19-ba72-24c7d82d2896 tempest-VolumeQuotasAdminTestJSON-638756912 None] Created volume successfully. Sep 03 13:38:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4a72d3ee-3577-4f77-b3fa-91502c9ab4ba tempest-VolumeQuotasAdminTestJSON-605743328 None] Transfer volume completed successfully. Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Acquiring lock "cinder-25186aca-7b66-49ae-9ff8-7aaadc00edb7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "cinder-25186aca-7b66-49ae-9ff8-7aaadc00edb7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Acquiring lock "cinder-quobyte-25186aca-7b66-49ae-9ff8-7aaadc00edb7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "cinder-quobyte-25186aca-7b66-49ae-9ff8-7aaadc00edb7" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e303d-0ded-487b-94a4-f42ce6a270af]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:03 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 Sep 03 13:38:03 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:04 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:04 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7 Sep 03 13:38:04 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:04 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-25186aca-7b66-49ae-9ff8-7aaadc00edb7" returned: 0 in 0.534s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "cinder-quobyte-25186aca-7b66-49ae-9ff8-7aaadc00edb7" released by "delete_volume" :: held 1.084s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Created reservations ['c09c25d0-04e9-4998-9c37-273786c59ce2', '31200753-1602-4331-9121-bdfbcc3d4fdc', '709d95dd-84e3-4d39-9f0d-402371cef1b5', 'ca2b9bc4-71e4-447f-b3c9-7ed68dfdabb9'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:05 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:05 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:05 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:05 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Deleted volume successfully. Sep 03 13:38:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-35696a86-702c-49eb-a1d6-94088d219a04 tempest-VolumeQuotasAdminTestJSON-1492688212 None] Lock "cinder-25186aca-7b66-49ae-9ff8-7aaadc00edb7-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (c374ba1a-34de-4a8e-8554-74488bd093a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8f3b71-c0b1-4ee3-86e4-a05fc847e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8f3b71-c0b1-4ee3-86e4-a05fc847e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1709284918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6477f9-0b50-44f4-8de9-9f23a4410062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:14Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2435fe94-d67d-49a6-8621-ac031b236d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2435fe94-d67d-49a6-8621-ac031b236d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcba35d-858b-4d40-acb7-e9eecfe36400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcba35d-858b-4d40-acb7-e9eecfe36400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6477f9-0b50-44f4-8de9-9f23a4410062', 'volume_name': 'volume-da6477f9-0b50-44f4-8de9-9f23a4410062', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b64a6fb-2de5-44d1-be41-ddbe55c0e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b64a6fb-2de5-44d1-be41-ddbe55c0e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9db0b2-4f72-49bf-bf6a-aae8b2c28215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Volume da6477f9-0b50-44f4-8de9-9f23a4410062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6477f9-0b50-44f4-8de9-9f23a4410062', 'volume_size': 1} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1709284918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6477f9-0b50-44f4-8de9-9f23a4410062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:14Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Creating volume da6477f9-0b50-44f4-8de9-9f23a4410062 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:14 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:14 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 1073741824 Sep 03 13:38:14 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:15 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 1073741824" returned: 0 in 0.807s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:15 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 Sep 03 13:38:15 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:15 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9db0b2-4f72-49bf-bf6a-aae8b2c28215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6477f9-0b50-44f4-8de9-9f23a4410062', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016be87-f1c1-4a7c-a6ba-dff25696dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:15 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Volume volume-da6477f9-0b50-44f4-8de9-9f23a4410062 (da6477f9-0b50-44f4-8de9-9f23a4410062): created successfully Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016be87-f1c1-4a7c-a6ba-dff25696dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (c374ba1a-34de-4a8e-8554-74488bd093a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0799825c-4e1f-42db-ac60-d610a80245ac tempest-AttachVolumeTestJSON-782672214 None] Created volume successfully. Sep 03 13:38:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-ba824e1b-3580-4c03-ad82-6243d8dda384 req-96c93dbe-d8fa-4ca9-80aa-a897bb88042e tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-ba824e1b-3580-4c03-ad82-6243d8dda384 req-96c93dbe-d8fa-4ca9-80aa-a897bb88042e tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-ba824e1b-3580-4c03-ad82-6243d8dda384 req-96c93dbe-d8fa-4ca9-80aa-a897bb88042e tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-ba824e1b-3580-4c03-ad82-6243d8dda384 req-96c93dbe-d8fa-4ca9-80aa-a897bb88042e tempest-AttachVolumeTestJSON-782672214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-da6477f9-0b50-44f4-8de9-9f23a4410062', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d022185-f20f-4ab8-8798-a12603aa36d8', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:38:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-ba824e1b-3580-4c03-ad82-6243d8dda384 req-96c93dbe-d8fa-4ca9-80aa-a897bb88042e tempest-AttachVolumeTestJSON-782672214 None] attachment_update completed successfully. Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Flow 'volume_create_manager' (acd9a089-8160-411d-a471-401c9726e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb064d2a-010b-4c60-86ec-a1440699c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb064d2a-010b-4c60-86ec-a1440699c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-343916272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3819ab-931e-4a2d-aba9-5ae719a8d0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5722d95801c3443fa59df57aa9b268d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:19Z,use_quota=True,user_id='47239ac71343456ab28377b0863cb542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ad63b1-5470-4052-a25a-8303f1737cf7),volume_type_id=51ad63b1-5470-4052-a25a-8303f1737cf7)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f849a4-0c52-4c44-b4d3-10a818c661bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f849a4-0c52-4c44-b4d3-10a818c661bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f8fbf0-366b-4aa4-9a44-58486d2f342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f8fbf0-366b-4aa4-9a44-58486d2f342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3819ab-931e-4a2d-aba9-5ae719a8d0be', 'volume_name': 'volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11212cf7-c168-4f0b-9927-d4c99387ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11212cf7-c168-4f0b-9927-d4c99387ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db7a11-4cf0-41e6-852c-a2c4e28c0b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:19 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Volume 7a3819ab-931e-4a2d-aba9-5ae719a8d0be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be', 'volume_size': 1} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-343916272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3819ab-931e-4a2d-aba9-5ae719a8d0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5722d95801c3443fa59df57aa9b268d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:19Z,use_quota=True,user_id='47239ac71343456ab28377b0863cb542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ad63b1-5470-4052-a25a-8303f1737cf7),volume_type_id=51ad63b1-5470-4052-a25a-8303f1737cf7)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Creating volume 7a3819ab-931e-4a2d-aba9-5ae719a8d0be {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:19 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:19 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be 1073741824 Sep 03 13:38:19 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:20 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be 1073741824" returned: 0 in 0.617s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:20 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be Sep 03 13:38:20 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:20 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" returned: 0 in 0.310s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db7a11-4cf0-41e6-852c-a2c4e28c0b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e1c151-e090-4a3e-9cac-2a6badc5edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:20 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Volume volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be (7a3819ab-931e-4a2d-aba9-5ae719a8d0be): created successfully Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e1c151-e090-4a3e-9cac-2a6badc5edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Flow 'volume_create_manager' (acd9a089-8160-411d-a471-401c9726e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:20 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4d0f88bd-ae2d-483e-a926-5fe44cfcafe5 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Created volume successfully. Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:21 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:21 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:22 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.278s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5aee50d4-c37d-41ac-bf44-54f590b47e9a tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Retype volume completed successfully. Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Flow 'volume_create_manager' (3953c6a8-2b16-44f5-b78f-309208603329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04d2ad7-ee45-4373-b12f-af3f1c563d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04d2ad7-ee45-4373-b12f-af3f1c563d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-981754380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955e764a-da89-489a-bb50-e2cadd1589e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555ce5a73e0b4d5aa566e220418e290c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:23Z,use_quota=True,user_id='196a3c52dd234494bbeb10af562854d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de30c2a4-d455-46b0-b01e-e320861c8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de30c2a4-d455-46b0-b01e-e320861c8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0d1f3e-165b-46a2-851a-d8e97dbccb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "cinder-7a3819ab-931e-4a2d-aba9-5ae719a8d0be-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "cinder-7a3819ab-931e-4a2d-aba9-5ae719a8d0be-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "cinder-quobyte-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "cinder-quobyte-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960deac-9a9e-41ae-b86f-f11e1b6935ff]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0d1f3e-165b-46a2-851a-d8e97dbccb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '955e764a-da89-489a-bb50-e2cadd1589e4', 'volume_name': 'volume-955e764a-da89-489a-bb50-e2cadd1589e4', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71244546-663d-486c-9059-586aa372e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71244546-663d-486c-9059-586aa372e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04da7f29-8724-4492-8113-bfd321dbd56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:23 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Volume 955e764a-da89-489a-bb50-e2cadd1589e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-955e764a-da89-489a-bb50-e2cadd1589e4', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 13:38:23 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Trying to clone 955e764a-da89-489a-bb50-e2cadd1589e4 from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:38:23 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be Sep 03 13:38:23 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:24 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:24 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be Sep 03 13:38:24 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:38:24 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Image download 20.69 MB at 20.69 MB/s Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[241aaf6e-f4fc-4a76-89a0-222a383a0d0c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:24 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD Sep 03 13:38:24 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:24 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "cinder-quobyte-7a3819ab-931e-4a2d-aba9-5ae719a8d0be" released by "delete_volume" :: held 0.898s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:24 devstack cinder-volume[86933]: WARNING cinder.quota [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:38:24 devstack cinder-volume[86933]: WARNING cinder.quota [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Created reservations ['103b59d1-436b-4914-89fe-3ff5011b5926', 'db8269c1-4414-406e-926f-84f0a1168f64', '5e1188fe-90ed-4369-abb2-0c3239a8b8f1', '07a427c5-c1cc-4b5e-9a5f-724cc02a2675'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:24 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 is fetched for user 196a3c52dd234494bbeb10af562854d2. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:24 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:24 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c34ff-570d-4985-b645-3e9ec6809fb9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:25 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Deleted volume successfully. Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5e91d164-9c6e-4cf7-a3c2-25c59ce25233 tempest-VolumeRetypeWithoutMigrationTest-1314205342 None] Lock "cinder-7a3819ab-931e-4a2d-aba9-5ae719a8d0be-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:25 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD Sep 03 13:38:25 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:25 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-981754380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955e764a-da89-489a-bb50-e2cadd1589e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555ce5a73e0b4d5aa566e220418e290c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:23Z,use_quota=True,user_id='196a3c52dd234494bbeb10af562854d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Creating volume 955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:25 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:25 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1073741824 Sep 03 13:38:25 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:26 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1073741824" returned: 0 in 0.612s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:26 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 Sep 03 13:38:26 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:26 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4" returned: 0 in 0.307s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Attempting download of 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 955e764a-da89-489a-bb50-e2cadd1589e4. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59085391-b554-4714-84cf-f7097f5d4b66]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:26 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22 Sep 03 13:38:26 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:27 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22" returned: 0 in 0.507s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:27 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22 Sep 03 13:38:27 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:27 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22" returned: 1 in 0.540s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_ogutpz22' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b5f69-9aa8-4b9e-9d33-7bcb6872f5ca]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:27 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD Sep 03 13:38:27 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:28 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:28 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:38:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:28 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 Sep 03 13:38:28 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:30 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4" returned: 0 in 2.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_asyod2dddevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:38:30 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Converted 112.00 MB image at 47.24 MB/s Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:30 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1G Sep 03 13:38:30 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:30 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 1G" returned: 0 in 0.384s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Downloaded image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume 955e764a-da89-489a-bb50-e2cadd1589e4 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 for user 196a3c52dd234494bbeb10af562854d2 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Marking volume 955e764a-da89-489a-bb50-e2cadd1589e4 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Copying metadata from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 to 955e764a-da89-489a-bb50-e2cadd1589e4. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:38:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Creating volume glance metadata for volume 955e764a-da89-489a-bb50-e2cadd1589e4 backed by image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04da7f29-8724-4492-8113-bfd321dbd56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955e764a-da89-489a-bb50-e2cadd1589e4', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f066c546-56ea-4a4f-874e-6a2381e21f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Volume volume-955e764a-da89-489a-bb50-e2cadd1589e4 (955e764a-da89-489a-bb50-e2cadd1589e4): created successfully Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f066c546-56ea-4a4f-874e-6a2381e21f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Flow 'volume_create_manager' (3953c6a8-2b16-44f5-b78f-309208603329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f85d32c9-2484-4555-aed5-7537c44e29a8 tempest-TestShelveInstance-1055945598 None] Created volume successfully. Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (fd1fda35-5af5-4106-9596-f8b05d7d5375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c4c84-98b4-4689-907a-e38ae70f90a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c4c84-98b4-4689-907a-e38ae70f90a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847844047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cca5292-c745-47bb-b3d8-2a198c151e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:31Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b15c98-ab25-4a96-a52e-9b033ac8e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b15c98-ab25-4a96-a52e-9b033ac8e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a232a98-4f50-4ff6-80b0-25c0197ceb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a232a98-4f50-4ff6-80b0-25c0197ceb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cca5292-c745-47bb-b3d8-2a198c151e63', 'volume_name': 'volume-0cca5292-c745-47bb-b3d8-2a198c151e63', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c39979c-0320-43b6-91d1-3cbdc2bf2428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c39979c-0320-43b6-91d1-3cbdc2bf2428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b5013-faa6-4a14-9d12-1e60f58b1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Volume 0cca5292-c745-47bb-b3d8-2a198c151e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cca5292-c745-47bb-b3d8-2a198c151e63', 'volume_size': 1} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847844047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cca5292-c745-47bb-b3d8-2a198c151e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607cfc237d9a4878b186c3edb95eb798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:31Z,use_quota=True,user_id='2eaccce84cbd422b9517e94b54231cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Creating volume 0cca5292-c745-47bb-b3d8-2a198c151e63 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:31 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:31 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 1073741824 Sep 03 13:38:31 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:31 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 1073741824" returned: 0 in 0.479s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:31 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 Sep 03 13:38:31 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:32 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b5013-faa6-4a14-9d12-1e60f58b1c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cca5292-c745-47bb-b3d8-2a198c151e63', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6927fda-c25b-4299-95c3-a39eca2fcf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:32 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Volume volume-0cca5292-c745-47bb-b3d8-2a198c151e63 (0cca5292-c745-47bb-b3d8-2a198c151e63): created successfully Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6927fda-c25b-4299-95c3-a39eca2fcf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Flow 'volume_create_manager' (fd1fda35-5af5-4106-9596-f8b05d7d5375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-765647bb-82b9-4f5e-b5d4-c3f6501a4fe3 tempest-AttachVolumeNegativeTest-1824734433 None] Created volume successfully. Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Flow 'volume_create_manager' (e6f877bd-e613-448f-96d8-f5df30b18a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bbc21a-31df-4143-9366-c8140eaf2b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bbc21a-31df-4143-9366-c8140eaf2b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1071964205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fba463d-b8f6-4565-8ec3-971b01259134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313d324778314366a34b7c12156f6b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:33Z,use_quota=True,user_id='49bc521299be4042b6c0426d8eac6ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff930d8-5e18-4a86-9330-e20102161306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff930d8-5e18-4a86-9330-e20102161306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0f528f-96b4-4eba-9ef2-5523a6836ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0f528f-96b4-4eba-9ef2-5523a6836ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fba463d-b8f6-4565-8ec3-971b01259134', 'volume_name': 'volume-5fba463d-b8f6-4565-8ec3-971b01259134', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495f2315-96a4-4c1b-92a5-1af1009be062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495f2315-96a4-4c1b-92a5-1af1009be062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf006c8f-1eda-4a30-bf82-17a5b4465a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:33 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Volume 5fba463d-b8f6-4565-8ec3-971b01259134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fba463d-b8f6-4565-8ec3-971b01259134', 'volume_size': 1} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1071964205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fba463d-b8f6-4565-8ec3-971b01259134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313d324778314366a34b7c12156f6b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:33Z,use_quota=True,user_id='49bc521299be4042b6c0426d8eac6ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Creating volume 5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:33 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:33 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 1073741824 Sep 03 13:38:33 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:33 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:33 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:33 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 1073741824" returned: 0 in 0.670s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=70,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:38:33 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=65,cinder:SELECT=60,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:34 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 Sep 03 13:38:34 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:34 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.688s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-93e185fc-a49d-4987-8161-76f29ded031e req-0bab1577-a701-4038-8c4a-85ef5680731f tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:34 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134" returned: 0 in 0.574s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-93e185fc-a49d-4987-8161-76f29ded031e req-0bab1577-a701-4038-8c4a-85ef5680731f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.019s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-93e185fc-a49d-4987-8161-76f29ded031e req-0bab1577-a701-4038-8c4a-85ef5680731f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf006c8f-1eda-4a30-bf82-17a5b4465a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fba463d-b8f6-4565-8ec3-971b01259134', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611cd463-11ff-4364-9bcc-60b91fd6189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:34 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Volume volume-5fba463d-b8f6-4565-8ec3-971b01259134 (5fba463d-b8f6-4565-8ec3-971b01259134): created successfully Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611cd463-11ff-4364-9bcc-60b91fd6189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Flow 'volume_create_manager' (e6f877bd-e613-448f-96d8-f5df30b18a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:34 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f37e1bc4-ba88-4c58-b1ec-81aea5e69385 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Created volume successfully. Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-93e185fc-a49d-4987-8161-76f29ded031e req-0bab1577-a701-4038-8c4a-85ef5680731f tempest-AttachVolumeNegativeTest-1824734433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-0cca5292-c745-47bb-b3d8-2a198c151e63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59f56824-eaba-4247-9e93-496bdaa9daf2', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:38:34 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-93e185fc-a49d-4987-8161-76f29ded031e req-0bab1577-a701-4038-8c4a-85ef5680731f tempest-AttachVolumeNegativeTest-1824734433 None] attachment_update completed successfully. Sep 03 13:38:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-c592647b-ea67-4257-b0c0-c2cbf12e1d37 req-efe87d47-711a-4e0e-a20e-bbd4f14783ea tempest-TestShelveInstance-1055945598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-c592647b-ea67-4257-b0c0-c2cbf12e1d37 req-efe87d47-711a-4e0e-a20e-bbd4f14783ea tempest-TestShelveInstance-1055945598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-c592647b-ea67-4257-b0c0-c2cbf12e1d37 req-efe87d47-711a-4e0e-a20e-bbd4f14783ea tempest-TestShelveInstance-1055945598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-c592647b-ea67-4257-b0c0-c2cbf12e1d37 req-efe87d47-711a-4e0e-a20e-bbd4f14783ea tempest-TestShelveInstance-1055945598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-955e764a-da89-489a-bb50-e2cadd1589e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f78958a-d535-4ff2-94fc-e2dbe3815e4e', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:38:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-c592647b-ea67-4257-b0c0-c2cbf12e1d37 req-efe87d47-711a-4e0e-a20e-bbd4f14783ea tempest-TestShelveInstance-1055945598 None] attachment_update completed successfully. Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Creating offline snapshot cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f of volume 5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6efd6-9247-476b-b49f-eca0b273947a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:36 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 Sep 03 13:38:36 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:36 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:36 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f 1G Sep 03 13:38:36 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:37 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f 1G" returned: 0 in 0.761s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fba463d-b8f6-4565-8ec3-971b01259134 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:37 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fba463d-b8f6-4565-8ec3-971b01259134 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f Sep 03 13:38:37 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:37 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fba463d-b8f6-4565-8ec3-971b01259134 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:37 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f is being set with open permissions: ugo+rw Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:37 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f Sep 03 13:38:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-a9b95f47-7681-4b98-892c-c15514835afb req-9696bf89-cc7d-43a5-91f6-44db222ef71b tempest-AttachVolumeNegativeTest-1824734433 None] Terminate volume connection completed successfully. Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-a9b95f47-7681-4b98-892c-c15514835afb req-9696bf89-cc7d-43a5-91f6-44db222ef71b tempest-AttachVolumeNegativeTest-1824734433 None] Deleting attachment 59f56824-eaba-4247-9e93-496bdaa9daf2. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:38:37 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:37 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:38 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info Sep 03 13:38:38 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:38 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info" returned: 0 in 0.580s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:38 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info is being set with open permissions: ugo+rw Sep 03 13:38:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:38 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info Sep 03 13:38:38 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:39 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.info" returned: 0 in 0.654s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b71a2b31-7958-45c5-933c-d8dd5d11e208 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Create snapshot completed successfully Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "cinder-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "cinder-quobyte-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Deleting offline snapshot cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f of volume 5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] snapshot_file for this snap is: volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f929f-5b6c-4925-b707-d2de96990d84]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:41 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f Sep 03 13:38:41 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:41 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" returned: 0 in 0.373s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fba463d-b8f6-4565-8ec3-971b01259134(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3f502-2b31-427c-aac9-c44e55fa7d88]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:41 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 Sep 03 13:38:41 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:42 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134" returned: 0 in 0.449s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:42 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f Sep 03 13:38:42 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:42 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" returned: 0 in 0.470s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:42 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f Sep 03 13:38:42 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:43 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134.cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" returned: 0 in 0.383s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f" released by "_delete_snapshot" :: held 1.818s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" released by "delete_snapshot" :: held 1.857s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Created reservations ['3c840efd-2806-4395-ba8b-918f16770dd1', '0fb3bf5a-2d03-4535-9c1c-e09fd94350f0', '374a41a6-cc33-47d4-9043-f02b89886b26', '1b9d020a-9993-43ba-9a86-ffa8b2048e30'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Delete snapshot completed successfully. Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-edd42065-3afb-4467-9509-b248ab3ab85f tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-cd8a18bf-ddd6-4b4d-b13e-cc9beede6f3f-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "cinder-5fba463d-b8f6-4565-8ec3-971b01259134-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-5fba463d-b8f6-4565-8ec3-971b01259134-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fd881e-d5b6-4a91-8d65-60699d06837c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:43 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 Sep 03 13:38:43 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:44 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134" returned: 0 in 0.417s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:44 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134 Sep 03 13:38:44 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:44 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5fba463d-b8f6-4565-8ec3-971b01259134" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-quobyte-5fba463d-b8f6-4565-8ec3-971b01259134" released by "delete_volume" :: held 0.787s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Created reservations ['92ceede3-df26-489e-8731-bc800517e1fd', '0ae03434-6530-4c27-9b34-d7836df26001', 'dcd2b29d-dcd2-4ff0-8e7c-0bf952629789', '8b3f83fe-a4f0-46c0-9f80-02a03d51b92a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:44 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:44 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:45 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.490s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:45 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Deleted volume successfully. Sep 03 13:38:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4719f424-1e7b-4761-a92f-f3de0ca105f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-646360 None] Lock "cinder-5fba463d-b8f6-4565-8ec3-971b01259134-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-0cca5292-c745-47bb-b3d8-2a198c151e63-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-0cca5292-c745-47bb-b3d8-2a198c151e63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-quobyte-0cca5292-c745-47bb-b3d8-2a198c151e63" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-0cca5292-c745-47bb-b3d8-2a198c151e63" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e39628-25fd-4ea2-b0d7-a31cac6799c7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:46 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 Sep 03 13:38:46 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:46 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63" returned: 0 in 0.535s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:46 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63 Sep 03 13:38:46 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:47 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0cca5292-c745-47bb-b3d8-2a198c151e63" returned: 0 in 0.356s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-0cca5292-c745-47bb-b3d8-2a198c151e63" released by "delete_volume" :: held 0.968s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Created reservations ['14f08389-5d3a-4b68-925a-6dfd218b41a0', '3dc1816f-a3f2-4571-9b7d-3735ea9f3667', '897b6e09-2d94-43e7-966c-04093c082234', 'e5d2ea40-75a8-4858-affd-774ae1352c91'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:47 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:47 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-b7ff8022-b89e-4dca-b4c3-2539d9422d73-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-b7ff8022-b89e-4dca-b4c3-2539d9422d73-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-quobyte-b7ff8022-b89e-4dca-b4c3-2539d9422d73" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-b7ff8022-b89e-4dca-b4c3-2539d9422d73" acquired by "delete_volume" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fc7b7-37ea-43a8-8ed0-0389fb7c4c4f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:47 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.573s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:48 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Deleted volume successfully. Sep 03 13:38:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b713e05c-15d1-46f0-bba3-cdffc8306ba6 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-0cca5292-c745-47bb-b3d8-2a198c151e63-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:48 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 Sep 03 13:38:48 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:48 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73" returned: 0 in 0.721s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:48 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73 Sep 03 13:38:48 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:49 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b7ff8022-b89e-4dca-b4c3-2539d9422d73" returned: 0 in 0.343s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-b7ff8022-b89e-4dca-b4c3-2539d9422d73" released by "delete_volume" :: held 1.146s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Created reservations ['8be4e4ca-bd28-41fc-9029-1c225e9d4910', '6c3ddd76-8780-4206-af7c-b707add3dfed', 'd75ea8c4-2e14-413e-9cda-41dbbb9de983', '7bda43e9-c29a-49ca-a6c3-87ebc5b13d68'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:49 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:49 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:49 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Deleted volume successfully. Sep 03 13:38:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55f8b967-30e7-4450-af5c-2d30c79cfd4f tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-b7ff8022-b89e-4dca-b4c3-2539d9422d73-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-0edcb05e-2a10-446e-8d48-80af5db5fc59-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-0edcb05e-2a10-446e-8d48-80af5db5fc59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "cinder-quobyte-0edcb05e-2a10-446e-8d48-80af5db5fc59" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-0edcb05e-2a10-446e-8d48-80af5db5fc59" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cee111-6bae-4594-9009-dc743c3d8e2d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:50 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 Sep 03 13:38:50 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:50 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59" returned: 0 in 0.422s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:50 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59 Sep 03 13:38:50 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:51 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0edcb05e-2a10-446e-8d48-80af5db5fc59" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-quobyte-0edcb05e-2a10-446e-8d48-80af5db5fc59" released by "delete_volume" :: held 0.764s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Created reservations ['644de0b2-de08-400c-96b5-c10809e71853', '0014a04c-fa70-4ce8-bdee-d32b357d9b7c', '5db05148-b1c6-4675-bab5-fd6b86ec0070', 'b741f63c-20d8-4379-a99e-c6685e3a2f39'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:51 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:51 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:51 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Deleted volume successfully. Sep 03 13:38:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53b339f2-7dcc-40b2-8de0-2eada3a0cae1 tempest-AttachVolumeNegativeTest-1824734433 None] Lock "cinder-0edcb05e-2a10-446e-8d48-80af5db5fc59-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Flow 'volume_create_manager' (ae5becf7-d196-491d-89a4-936275566cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462aafc2-df29-4f55-8b97-107a590f1537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462aafc2-df29-4f55-8b97-107a590f1537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2061740916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c7096c0c84f18baa3ccca2ee16001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:55Z,use_quota=True,user_id='a56cf6043c1f4d7db46e95fa25b3ead0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c13c852-0c50-46de-a599-4e1985698af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c13c852-0c50-46de-a599-4e1985698af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84caebb-3fa6-4da9-b20f-af3cfdf588f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84caebb-3fa6-4da9-b20f-af3cfdf588f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1', 'volume_name': 'volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839c6bf7-854f-4dc0-b7ae-2055b4154902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839c6bf7-854f-4dc0-b7ae-2055b4154902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ea97e0-32de-49b1-947d-9856698c0ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Volume 9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1', 'volume_size': 1} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2061740916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c7096c0c84f18baa3ccca2ee16001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:38:55Z,use_quota=True,user_id='a56cf6043c1f4d7db46e95fa25b3ead0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Creating volume 9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:38:55 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:38:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:55 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 1073741824 Sep 03 13:38:55 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:56 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 1073741824" returned: 0 in 0.812s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:56 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 Sep 03 13:38:56 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:56 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ea97e0-32de-49b1-947d-9856698c0ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb051b5-d97c-4ad2-b843-93fb89a180a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:38:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Volume volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 (9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1): created successfully Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb051b5-d97c-4ad2-b843-93fb89a180a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:38:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Flow 'volume_create_manager' (ae5becf7-d196-491d-89a4-936275566cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:38:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6dd0097f-da1f-440b-a813-682dcde96e56 tempest-AbsoluteLimitsTests-1205972115 None] Created volume successfully. Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Acquiring lock "cinder-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "cinder-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Acquiring lock "cinder-quobyte-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "cinder-quobyte-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3d0a6-4539-478f-84c2-f1dc4c8b6779]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:57 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 Sep 03 13:38:57 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:57 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:57 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1 Sep 03 13:38:58 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:58 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "cinder-quobyte-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1" released by "delete_volume" :: held 0.818s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Created reservations ['6dec14bf-d44a-4c40-9195-983a1061c1e8', '24135cd9-0363-44e7-bec0-a1ab1d888810', '7336643b-47e7-448c-8c40-ed9010482af4', '51c4b8ee-daa2-47e4-8e33-5ee347f53345'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:38:58 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:38:58 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:38:58 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:38:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Deleted volume successfully. Sep 03 13:38:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-55c0cbde-e835-4d9c-94f7-89ac58c074b0 tempest-AbsoluteLimitsTests-1205972115 None] Lock "cinder-9b5223dc-ac00-47d4-9ecf-fb6ae63b72d1-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:03 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-d7193721-c50d-4d5d-8dee-d4d775b595ef req-ec7968b4-212f-4dd7-9021-d7544e46c7be tempest-AttachVolumeTestJSON-782672214 None] Terminate volume connection completed successfully. Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-d7193721-c50d-4d5d-8dee-d4d775b595ef req-ec7968b4-212f-4dd7-9021-d7544e46c7be tempest-AttachVolumeTestJSON-782672214 None] Deleting attachment 4d022185-f20f-4ab8-8798-a12603aa36d8. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (72dd239b-250d-470f-94b6-28643a9f1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd508e5-4694-4a0d-b8e4-94a45181d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd508e5-4694-4a0d-b8e4-94a45181d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1665105999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771dc9b1-ca46-4038-8bc6-570f6cf80931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85830f628f94f6f9298ad5409b23c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:03Z,use_quota=True,user_id='6624bd9cd9924326b7549715884d7ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f88fc4-6b73-4853-aaf0-a5b951d6a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f88fc4-6b73-4853-aaf0-a5b951d6a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f7fbd7-4abf-4b30-827e-61e0cfc7843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f7fbd7-4abf-4b30-827e-61e0cfc7843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771dc9b1-ca46-4038-8bc6-570f6cf80931', 'volume_name': 'volume-771dc9b1-ca46-4038-8bc6-570f6cf80931', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcad6a3-a786-4dd7-b3e3-399761e4baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcad6a3-a786-4dd7-b3e3-399761e4baef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3c0e07-9f28-4b20-8c82-e0286adbc4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:03 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Volume 771dc9b1-ca46-4038-8bc6-570f6cf80931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771dc9b1-ca46-4038-8bc6-570f6cf80931', 'volume_size': 1} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1665105999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771dc9b1-ca46-4038-8bc6-570f6cf80931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85830f628f94f6f9298ad5409b23c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:03Z,use_quota=True,user_id='6624bd9cd9924326b7549715884d7ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Creating volume 771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:03 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:03 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 1073741824 Sep 03 13:39:03 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:03 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 1073741824" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:03 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:03 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:04 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.314s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3c0e07-9f28-4b20-8c82-e0286adbc4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771dc9b1-ca46-4038-8bc6-570f6cf80931', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87a237-447b-4917-b6b4-94decc8521ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Volume volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 (771dc9b1-ca46-4038-8bc6-570f6cf80931): created successfully Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87a237-447b-4917-b6b4-94decc8521ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (72dd239b-250d-470f-94b6-28643a9f1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-732c69d1-d965-4ed2-a39a-900b8e602ee7 tempest-VolumesDeleteCascade-1206616076 None] Created volume successfully. Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967319c9-0a2a-46ff-813c-fb54ace6da04 tempest-BackendsCapabilitiesAdminTestsJSON-721142268 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8440437316895, 'free_capacity_gb': 1773.8440437316895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86933) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 13:39:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e6e3421b-3f1d-4ea6-a83c-0ab982b9a338 tempest-BackendsCapabilitiesAdminTestsJSON-721142268 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8440437316895, 'free_capacity_gb': 1773.8440437316895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86933) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Creating offline snapshot 1da68345-ac59-4c72-ac73-ae0ea5c3d9aa of volume 771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[932635a4-c56c-4fe6-9a59-5dbf34d8ac7f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:05 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:05 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:05 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:05 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa 1G Sep 03 13:39:05 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:06 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa 1G" returned: 0 in 0.598s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:06 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:06 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:06 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:06 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa is being set with open permissions: ugo+rw Sep 03 13:39:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:06 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:06 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:07 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.688s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:07 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info Sep 03 13:39:07 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:08 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info" returned: 0 in 0.399s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:08 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info is being set with open permissions: ugo+rw Sep 03 13:39:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:08 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info Sep 03 13:39:08 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:08 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.info" returned: 0 in 0.396s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2bb40053-5832-4d28-bcdf-b9451d51347f tempest-VolumesDeleteCascade-1206616076 None] Create snapshot completed successfully Sep 03 13:39:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Creating offline snapshot 3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 of volume 771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:39:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[825c720e-eefb-4888-ae15-cbd5d2ff8e20]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:10 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:10 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:10 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.719s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771dc9b1-ca46-4038-8bc6-570f6cf80931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:10 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 1G Sep 03 13:39:10 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:11 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 1G" returned: 0 in 0.606s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:11 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:11 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:11 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:11 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 is being set with open permissions: ugo+rw Sep 03 13:39:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:11 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:11 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:12 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.582s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b8699bbc-5a21-42b8-8919-011532817ea6 tempest-VolumesDeleteCascade-1206616076 None] Create snapshot completed successfully Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-771dc9b1-ca46-4038-8bc6-570f6cf80931-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-771dc9b1-ca46-4038-8bc6-570f6cf80931-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Performing cascade delete. {{(pid=86933) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Deleting offline snapshot 1da68345-ac59-4c72-ac73-ae0ea5c3d9aa of volume 771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] snapshot_file for this snap is: volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacdedfe-d607-4cd0-8b40-22a382f9499e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-b1362761-7c4e-4541-bb3e-aac18857d7d9 req-053f423c-a444-4a49-9cf7-bf6d042cc850 tempest-TestShelveInstance-1055945598 None] Terminate volume connection completed successfully. Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-b1362761-7c4e-4541-bb3e-aac18857d7d9 req-053f423c-a444-4a49-9cf7-bf6d042cc850 tempest-TestShelveInstance-1055945598 None] Deleting attachment 4f78958a-d535-4ff2-94fc-e2dbe3815e4e. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:13 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:13 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Flow 'volume_create_manager' (f0b7a000-6d13-4f35-85fb-463e9e35a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2013e3-991b-454d-b24d-f080cd1409df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2013e3-991b-454d-b24d-f080cd1409df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-340201162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf14561d-d75d-43d6-bb16-4039903e698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e22b0426741d0b6d1250b7e45d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:14Z,use_quota=True,user_id='b5175e69956943bca66ca934601bc1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7cdc0b-4ac4-4050-bb6f-4311459ccebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7cdc0b-4ac4-4050-bb6f-4311459ccebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d35b52-0acd-4fa2-865f-08bf27114704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d35b52-0acd-4fa2-865f-08bf27114704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf14561d-d75d-43d6-bb16-4039903e698e', 'volume_name': 'volume-bf14561d-d75d-43d6-bb16-4039903e698e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72d3518-209a-4773-a946-5fdbebd33e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72d3518-209a-4773-a946-5fdbebd33e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c7a2b-6566-4d48-917a-11d2fa6f87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:13 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Volume bf14561d-d75d-43d6-bb16-4039903e698e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf14561d-d75d-43d6-bb16-4039903e698e', 'volume_size': 1} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-340201162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf14561d-d75d-43d6-bb16-4039903e698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e22b0426741d0b6d1250b7e45d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:14Z,use_quota=True,user_id='b5175e69956943bca66ca934601bc1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Creating volume bf14561d-d75d-43d6-bb16-4039903e698e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:13 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:13 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e 1073741824 Sep 03 13:39:13 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:13 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.454s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771dc9b1-ca46-4038-8bc6-570f6cf80931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb84b4-a9be-40b5-92dc-92b53ad19f29]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:14 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:14 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:14 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e 1073741824" returned: 0 in 0.585s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:14 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.496s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:14 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e Sep 03 13:39:14 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aeb105-a1ba-4295-a499-b97aa6adf3b2]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:14 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:14 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:14 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c7a2b-6566-4d48-917a-11d2fa6f87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf14561d-d75d-43d6-bb16-4039903e698e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ff9fc-2a0c-48f5-aae1-bcbbc5d1ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Volume volume-bf14561d-d75d-43d6-bb16-4039903e698e (bf14561d-d75d-43d6-bb16-4039903e698e): created successfully Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ff9fc-2a0c-48f5-aae1-bcbbc5d1ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Flow 'volume_create_manager' (f0b7a000-6d13-4f35-85fb-463e9e35a153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c96403e6-29d4-45ff-ad1a-3c115f602b68 tempest-VolumesServicesTestJSON-695342628 None] Created volume successfully. Sep 03 13:39:14 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.378s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771dc9b1-ca46-4038-8bc6-570f6cf80931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb2b0b0-bd99-4178-ae55-1dfe5df5ef32]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:15 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:15 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:15 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771dc9b1-ca46-4038-8bc6-570f6cf80931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf92117-0b38-49bd-91f1-37c02d507d29]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:15 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:15 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:15 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Acquiring lock "cinder-bf14561d-d75d-43d6-bb16-4039903e698e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.554s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "cinder-bf14561d-d75d-43d6-bb16-4039903e698e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:15 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:15 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Acquiring lock "cinder-quobyte-bf14561d-d75d-43d6-bb16-4039903e698e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "cinder-quobyte-bf14561d-d75d-43d6-bb16-4039903e698e" acquired by "delete_volume" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ead8b1-a574-43e2-a15a-7b233bfb3bbf]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:16 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e Sep 03 13:39:16 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:16 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.457s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:16 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa Sep 03 13:39:16 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:16 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e" returned: 0 in 0.601s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:16 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e Sep 03 13:39:16 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:16 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" returned: 0 in 0.406s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 -F qcow2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:16 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 -F qcow2 Sep 03 13:39:16 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3d723fbf-6ef5-416e-a5f6-84154586a97d req-c39db4a2-d624-4ded-9c10-2b29f326cc28 tempest-TestShelveInstance-1055945598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3d723fbf-6ef5-416e-a5f6-84154586a97d req-c39db4a2-d624-4ded-9c10-2b29f326cc28 tempest-TestShelveInstance-1055945598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3d723fbf-6ef5-416e-a5f6-84154586a97d req-c39db4a2-d624-4ded-9c10-2b29f326cc28 tempest-TestShelveInstance-1055945598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-3d723fbf-6ef5-416e-a5f6-84154586a97d req-c39db4a2-d624-4ded-9c10-2b29f326cc28 tempest-TestShelveInstance-1055945598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-955e764a-da89-489a-bb50-e2cadd1589e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05d36db6-1bd3-4c73-aac6-770ca0c6e4c5', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:39:17 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf14561d-d75d-43d6-bb16-4039903e698e" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "cinder-quobyte-bf14561d-d75d-43d6-bb16-4039903e698e" released by "delete_volume" :: held 1.087s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-3d723fbf-6ef5-416e-a5f6-84154586a97d req-c39db4a2-d624-4ded-9c10-2b29f326cc28 tempest-TestShelveInstance-1055945598 None] attachment_update completed successfully. Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Created reservations ['98b04ef0-b956-4919-97c7-8fda198244eb', 'ef2ed9f6-eda2-4382-bc4a-d85cf5888e79', 'd3aceabb-5825-436a-b9d6-e7468857718c', 'b5654afc-7b72-4627-837c-310bf51fc0ac'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:17 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 -F qcow2" returned: 0 in 0.451s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa" released by "_delete_snapshot" :: held 3.835s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" released by "delete_snapshot" :: held 3.886s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:17 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:17 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['95bd60e4-565e-4d6d-b6c0-7f8bb2e2fc29', 'edfa65ce-fbb0-4bcc-849d-307f1004d1a6', '90ebdbed-cc20-4a82-8177-a64dd1a142b0', '6078b650-3f44-426a-9a51-2d77348dc4da'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Delete snapshot completed successfully. Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-1da68345-ac59-4c72-ac73-ae0ea5c3d9aa-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Deleting offline snapshot 3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 of volume 771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] snapshot_file for this snap is: volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed556e-61ba-473a-bf5f-5b32ca3a4e7d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:17 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.408s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Deleted volume successfully. Sep 03 13:39:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6efbc47-0dc3-4d71-83b0-8e46a232b73d tempest-VolumesServicesTestJSON-695342628 None] Lock "cinder-bf14561d-d75d-43d6-bb16-4039903e698e-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:17 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:17 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:18 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.562s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771dc9b1-ca46-4038-8bc6-570f6cf80931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc2e08-6a36-4d83-ab3d-9b915333a1f9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:18 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:18 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:18 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.492s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:18 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:18 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:19 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.484s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:19 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7 Sep 03 13:39:19 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:19 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931.3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" returned: 0 in 0.406s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7" released by "_delete_snapshot" :: held 2.119s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" released by "delete_snapshot" :: held 2.158s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:19 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['71b78872-e866-4540-b7ea-f1a952699dda', 'ca180061-9956-4a43-85f8-0cc58fb6ae38', 'ee16ecb2-ce05-44b7-88da-598251722ece', 'a53c0fc1-60ee-4dee-a02e-3d6ee17446a8'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:20 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Delete snapshot completed successfully. Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-3a7faeb9-43be-4b01-8efb-b1ec06ab5ce7-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Snapshots deleted, issuing volume delete {{(pid=86933) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f232df36-db68-470f-b133-1c7e762c429a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:20 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:20 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:20 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.587s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:20 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931 Sep 03 13:39:20 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:21 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-771dc9b1-ca46-4038-8bc6-570f6cf80931" returned: 0 in 0.541s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-771dc9b1-ca46-4038-8bc6-570f6cf80931" released by "delete_volume" :: held 1.264s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['89559e92-d9b4-443a-b6e3-b6ec3611a029', '39a570b3-d818-471f-87a3-c0a61157369c', '3043993b-09b8-48c6-9a98-bef2a519edc9', 'c432353d-ddc3-4623-8a75-855754466d66'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:21 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:21 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:22 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.607s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:22 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Deleted volume successfully. Sep 03 13:39:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-491754d2-9d60-4389-ae41-9ad4b3f9dd57 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-771dc9b1-ca46-4038-8bc6-570f6cf80931-delete_volume" released by "delete_volume" :: held 9.152s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (9fd3efab-9b43-47e8-a846-2908bc799613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d485be85-8dc1-4d95-9e4e-6da864cdb155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d485be85-8dc1-4d95-9e4e-6da864cdb155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-507455755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab433beb-99db-4611-9645-95ed82bacf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85830f628f94f6f9298ad5409b23c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:23Z,use_quota=True,user_id='6624bd9cd9924326b7549715884d7ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432d33e-ebec-4f11-a15a-25449a72109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432d33e-ebec-4f11-a15a-25449a72109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693aa95a-e2e3-420b-a6c9-76d58978ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693aa95a-e2e3-420b-a6c9-76d58978ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab433beb-99db-4611-9645-95ed82bacf28', 'volume_name': 'volume-ab433beb-99db-4611-9645-95ed82bacf28', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8479bd-3878-40c1-bdb5-afb68d130527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8479bd-3878-40c1-bdb5-afb68d130527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a767f55-c22f-4ec0-a676-4c84093daf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:23 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Volume ab433beb-99db-4611-9645-95ed82bacf28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab433beb-99db-4611-9645-95ed82bacf28', 'volume_size': 1} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-507455755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab433beb-99db-4611-9645-95ed82bacf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85830f628f94f6f9298ad5409b23c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:23Z,use_quota=True,user_id='6624bd9cd9924326b7549715884d7ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Creating volume ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:23 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:23 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 1073741824 Sep 03 13:39:23 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:24 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 1073741824" returned: 0 in 0.616s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:24 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:24 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:24 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a767f55-c22f-4ec0-a676-4c84093daf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab433beb-99db-4611-9645-95ed82bacf28', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bda7d2-b1ca-4c8d-9c4f-810d0d60adb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:24 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Volume volume-ab433beb-99db-4611-9645-95ed82bacf28 (ab433beb-99db-4611-9645-95ed82bacf28): created successfully Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bda7d2-b1ca-4c8d-9c4f-810d0d60adb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (9fd3efab-9b43-47e8-a846-2908bc799613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-039bc809-c3ec-435a-afd8-517519bf483c tempest-VolumesDeleteCascade-1206616076 None] Created volume successfully. Sep 03 13:39:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Creating offline snapshot 41a3a373-6517-4f3e-a29a-464c06c2b862 of volume ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:39:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f860666-b3c3-4aba-91f3-974fd622e048]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:25 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:25 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:26 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.476s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:26 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 1G Sep 03 13:39:26 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:26 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 1G" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab433beb-99db-4611-9645-95ed82bacf28 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:26 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab433beb-99db-4611-9645-95ed82bacf28 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:26 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:27 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab433beb-99db-4611-9645-95ed82bacf28 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.360s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 is being set with open permissions: ugo+rw Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:27 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:27 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:27 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:27 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info Sep 03 13:39:27 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:27 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info is being set with open permissions: ugo+rw Sep 03 13:39:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:27 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info Sep 03 13:39:27 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:28 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.info" returned: 0 in 0.348s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-56624e37-0fe8-4d90-b948-ca01ccfb4ca5 tempest-VolumesDeleteCascade-1206616076 None] Create snapshot completed successfully Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (461b1894-9929-49cc-bc3c-4d4c4ddd8d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3841c-134a-494d-a524-c3bac93d4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3841c-134a-494d-a524-c3bac93d4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-976044445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fae41e6-ccf2-4198-89b5-20e8bba62bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85830f628f94f6f9298ad5409b23c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41a3a373-6517-4f3e-a29a-464c06c2b862,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:30Z,use_quota=True,user_id='6624bd9cd9924326b7549715884d7ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f22a6d4-7c51-4878-b045-16bb6f931a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f22a6d4-7c51-4878-b045-16bb6f931a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b5d87c-1a29-4778-a39e-dac8bef4a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b5d87c-1a29-4778-a39e-dac8bef4a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fae41e6-ccf2-4198-89b5-20e8bba62bb7', 'volume_name': 'volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7', 'volume_size': 1, 'snapshot_id': '41a3a373-6517-4f3e-a29a-464c06c2b862'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed993ef-892e-416b-9d4b-5e1b1a8da890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed993ef-892e-416b-9d4b-5e1b1a8da890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd18f5-9675-4243-94e4-226ecebf4d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Volume 7fae41e6-ccf2-4198-89b5-20e8bba62bb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7', 'volume_size': 1, 'snapshot_id': '41a3a373-6517-4f3e-a29a-464c06c2b862'} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Creating volume 7fae41e6-ccf2-4198-89b5-20e8bba62bb7 from snapshot 41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] snapshot: 41a3a373-6517-4f3e-a29a-464c06c2b862, volume: 7fae41e6-ccf2-4198-89b5-20e8bba62bb7, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ccbdf6-e286-4b9a-ab85-06504062f276]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:30 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:30 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:30 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab433beb-99db-4611-9645-95ed82bacf28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c04f3c-34f3-4d81-bc3e-b005e36b66da]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:30 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:30 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:30 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.463s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:39:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:30 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 Sep 03 13:39:30 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:33 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:33 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:35 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 1.566s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:35 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:35 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:39:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:39:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:39:39 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=94,cinder:INSERT=27,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" returned: 0 in 8.384s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:39:39 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Converted 1024.00 MB image at 122.03 MB/s Sep 03 13:39:39 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 is being set with open permissions: ugo+rw Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=101,cinder:UPDATE=86,cinder:INSERT=21,cinder:DELETE=10 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:39 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 Sep 03 13:39:39 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Flow 'volume_create_manager' (e36dbcd7-5585-45a0-9ef6-137022d3ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6cb481-f63d-4641-9c76-667a7c55522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6cb481-f63d-4641-9c76-667a7c55522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-849006847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610b39ee-96d8-444b-8bd6-e06076f88dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaabe68cd68f418ca5319dd95a002c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:39Z,use_quota=True,user_id='4f0eb117fa1d4665bb91779826e8c6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b018aae-b7e6-4075-811d-258f0308ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b018aae-b7e6-4075-811d-258f0308ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ca1bd4-78f1-441e-ae0c-a6bd4e13ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ca1bd4-78f1-441e-ae0c-a6bd4e13ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610b39ee-96d8-444b-8bd6-e06076f88dab', 'volume_name': 'volume-610b39ee-96d8-444b-8bd6-e06076f88dab', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb3338-1bdc-4e5a-b54a-f74db0055693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb3338-1bdc-4e5a-b54a-f74db0055693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d13210-043d-4cda-94b8-57585a1b691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Volume 610b39ee-96d8-444b-8bd6-e06076f88dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610b39ee-96d8-444b-8bd6-e06076f88dab', 'volume_size': 1} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:39 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" returned: 0 in 0.286s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" released by "_copy_volume_from_snapshot" :: held 9.679s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" released by "_create_volume_from_snapshot" :: held 9.767s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.793s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-849006847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610b39ee-96d8-444b-8bd6-e06076f88dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaabe68cd68f418ca5319dd95a002c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:39Z,use_quota=True,user_id='4f0eb117fa1d4665bb91779826e8c6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Creating volume 610b39ee-96d8-444b-8bd6-e06076f88dab {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:39 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:39 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab 1073741824 Sep 03 13:39:39 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd18f5-9675-4243-94e4-226ecebf4d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7', 'volume_size': 1, 'snapshot_id': '41a3a373-6517-4f3e-a29a-464c06c2b862'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b355c6-9038-4efa-bbd8-fd17fb4ea2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Volume volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 (7fae41e6-ccf2-4198-89b5-20e8bba62bb7): created successfully Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b355c6-9038-4efa-bbd8-fd17fb4ea2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Flow 'volume_create_manager' (461b1894-9929-49cc-bc3c-4d4c4ddd8d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1a8299c0-7988-4526-8efd-a5d8ee090ff6 tempest-VolumesDeleteCascade-1206616076 None] Created volume successfully. Sep 03 13:39:39 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab 1073741824" returned: 0 in 0.416s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:40 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab Sep 03 13:39:40 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:40 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d13210-043d-4cda-94b8-57585a1b691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610b39ee-96d8-444b-8bd6-e06076f88dab', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e40a74-0639-470e-bfda-615af28d9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Volume volume-610b39ee-96d8-444b-8bd6-e06076f88dab (610b39ee-96d8-444b-8bd6-e06076f88dab): created successfully Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e40a74-0639-470e-bfda-615af28d9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Flow 'volume_create_manager' (e36dbcd7-5585-45a0-9ef6-137022d3ef70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-48ad689c-63ea-42b3-adcf-ea3938c5a4bb tempest-VolumesMetadataTest-790206046 None] Created volume successfully. Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-ab433beb-99db-4611-9645-95ed82bacf28-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-ab433beb-99db-4611-9645-95ed82bacf28-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Performing cascade delete. {{(pid=86933) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-41a3a373-6517-4f3e-a29a-464c06c2b862-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-41a3a373-6517-4f3e-a29a-464c06c2b862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Deleting offline snapshot 41a3a373-6517-4f3e-a29a-464c06c2b862 of volume ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] snapshot_file for this snap is: volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0e38a-d3c9-40af-84b5-64a1d8095907]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:40 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:40 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:41 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab433beb-99db-4611-9645-95ed82bacf28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ff5d4-d0b8-4822-bd33-313f857d3393]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:41 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:41 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:41 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.579s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Acquiring lock "cinder-610b39ee-96d8-444b-8bd6-e06076f88dab-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:41 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:41 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "cinder-610b39ee-96d8-444b-8bd6-e06076f88dab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Acquiring lock "cinder-quobyte-610b39ee-96d8-444b-8bd6-e06076f88dab" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "cinder-quobyte-610b39ee-96d8-444b-8bd6-e06076f88dab" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[174cf24f-de5b-4fad-bd41-cd7417a9f4e5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:42 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab Sep 03 13:39:42 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:42 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:42 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862 Sep 03 13:39:42 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:42 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:42 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab Sep 03 13:39:42 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:42 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28.41a3a373-6517-4f3e-a29a-464c06c2b862" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-41a3a373-6517-4f3e-a29a-464c06c2b862" released by "_delete_snapshot" :: held 1.801s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" released by "delete_snapshot" :: held 1.824s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['556ee120-e266-4513-af67-7c256331f453', '86dc8ed3-a201-4db6-9ee3-040205342aed', 'e45d5052-f20e-4c53-b09b-348de92ba60a', '5e7d4b2e-af99-4a25-922e-118d0b5a398f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:42 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-610b39ee-96d8-444b-8bd6-e06076f88dab" returned: 0 in 0.278s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "cinder-quobyte-610b39ee-96d8-444b-8bd6-e06076f88dab" released by "delete_volume" :: held 0.738s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Delete snapshot completed successfully. Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-41a3a373-6517-4f3e-a29a-464c06c2b862-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Snapshots deleted, issuing volume delete {{(pid=86933) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Created reservations ['3bc1be9e-1a91-4730-8c4b-7fc63bc276d1', 'a7bec5b1-6b75-4187-a595-e34d5d50deb6', 'aeae5b1f-4f8f-4f08-8dd2-8524fb6a842d', '92ef908d-8968-42be-b55a-ff88ed69efca'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84382e64-d7a3-43dd-94ae-5a32e6cc5a04]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:42 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:42 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:42 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:42 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:43 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Deleted volume successfully. Sep 03 13:39:43 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.438s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-71d635b4-7d68-4a83-9669-07c78c369726 tempest-VolumesMetadataTest-790206046 None] Lock "cinder-610b39ee-96d8-444b-8bd6-e06076f88dab-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:43 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28 Sep 03 13:39:43 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:43 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ab433beb-99db-4611-9645-95ed82bacf28" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-ab433beb-99db-4611-9645-95ed82bacf28" released by "delete_volume" :: held 0.761s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['486a971e-4629-4015-8a47-afa414489812', '1751dc63-41b4-4793-8a2e-8a95271b75ce', '6b3c8a5e-8c3e-418e-a097-5447c083ae52', 'fe6d2304-a7d8-4bea-8647-014c44e6c600'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:43 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:43 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:43 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Deleted volume successfully. Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7bd88d-3b1d-41b8-aa40-4290604b7608 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-ab433beb-99db-4611-9645-95ed82bacf28-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-7fae41e6-ccf2-4198-89b5-20e8bba62bb7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-7fae41e6-ccf2-4198-89b5-20e8bba62bb7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc4ee3-ad05-40cc-b1d9-c49fc96b77b3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:44 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 Sep 03 13:39:44 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:44 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" returned: 0 in 0.423s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:44 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7 Sep 03 13:39:44 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:44 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-quobyte-7fae41e6-ccf2-4198-89b5-20e8bba62bb7" released by "delete_volume" :: held 0.778s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Created reservations ['cf4ecb71-d1ac-43d6-bd06-a5c1683ddfd8', '008f9187-aa92-492c-abc8-3ee08cf5bd42', '0ed90d6f-bd94-48de-a0a6-dee8cafb3a12', '1ddcd20e-bdd0-4fb6-b5df-ee14cac3e13a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:45 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:45 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:45 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Deleted volume successfully. Sep 03 13:39:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9f4d29a4-7883-4cca-8636-e708384b9092 tempest-VolumesDeleteCascade-1206616076 None] Lock "cinder-7fae41e6-ccf2-4198-89b5-20e8bba62bb7-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Flow 'volume_create_manager' (3b74268e-2ba4-4295-a25a-729a47da862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70343c2a-1590-4c34-a826-ca9b333baf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70343c2a-1590-4c34-a826-ca9b333baf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-383747630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e078de-19b1-44d9-aaff-e1157f4dd52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f4e01db6b248d5b810da085f6dd38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:49Z,use_quota=True,user_id='d680e2f3918e4be3b7b401292c8546da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb5ee4c-798a-4c29-b022-dac652cfbe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb5ee4c-798a-4c29-b022-dac652cfbe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd24576-b84e-4ee8-b19a-9b4ba3907b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd24576-b84e-4ee8-b19a-9b4ba3907b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e078de-19b1-44d9-aaff-e1157f4dd52b', 'volume_name': 'volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ec0fae-bdc0-4104-9782-5f8d7f68c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ec0fae-bdc0-4104-9782-5f8d7f68c233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be92095-40df-456a-a0c6-5dc90c5cf06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Volume a9e078de-19b1-44d9-aaff-e1157f4dd52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b', 'volume_size': 1} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-383747630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e078de-19b1-44d9-aaff-e1157f4dd52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f4e01db6b248d5b810da085f6dd38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:49Z,use_quota=True,user_id='d680e2f3918e4be3b7b401292c8546da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Creating volume a9e078de-19b1-44d9-aaff-e1157f4dd52b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:49 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:49 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b 1073741824 Sep 03 13:39:49 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:49 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b 1073741824" returned: 0 in 0.562s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:49 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b Sep 03 13:39:49 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:50 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be92095-40df-456a-a0c6-5dc90c5cf06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8797c3a-dff4-41d5-b1ca-5e076b7a1bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Volume volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b (a9e078de-19b1-44d9-aaff-e1157f4dd52b): created successfully Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8797c3a-dff4-41d5-b1ca-5e076b7a1bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Flow 'volume_create_manager' (3b74268e-2ba4-4295-a25a-729a47da862a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ee279105-56d5-4c5d-b954-93a437f872a5 tempest-VolumesTransfersV357Test-65153545 None] Created volume successfully. Sep 03 13:39:51 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Flow 'volume_create_manager' (2f112612-674a-4641-868c-25fb4f66c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddbc73d-e436-413a-8193-302b4795cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddbc73d-e436-413a-8193-302b4795cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1724722255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6278cf4-5f07-4732-ace6-0f0fbdf9792c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ce04293e964407a82c70e8b81fa3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:52Z,use_quota=True,user_id='83e791d959ec48dfbdae479acc06ee55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85500728-ea27-4fca-8b6d-25137ead898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85500728-ea27-4fca-8b6d-25137ead898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0631dfec-e8fd-4f5a-8151-4d6b07bd4b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0631dfec-e8fd-4f5a-8151-4d6b07bd4b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6278cf4-5f07-4732-ace6-0f0fbdf9792c', 'volume_name': 'volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c713d4-470e-411b-bdc1-7b0b58cca6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c713d4-470e-411b-bdc1-7b0b58cca6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083c3a4-a080-426c-ac77-51ef849bd7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:52 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Volume f6278cf4-5f07-4732-ace6-0f0fbdf9792c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c', 'volume_size': 1} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1724722255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6278cf4-5f07-4732-ace6-0f0fbdf9792c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ce04293e964407a82c70e8b81fa3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:52Z,use_quota=True,user_id='83e791d959ec48dfbdae479acc06ee55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Creating volume f6278cf4-5f07-4732-ace6-0f0fbdf9792c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:52 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:52 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c 1073741824 Sep 03 13:39:52 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f0216677-63a1-4f63-80f7-5b99c38a9b61 tempest-VolumesTransfersV357Test-340360484 None] Transfer volume completed successfully. Sep 03 13:39:52 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c 1073741824" returned: 0 in 0.554s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:52 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c Sep 03 13:39:52 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "cinder-a9e078de-19b1-44d9-aaff-e1157f4dd52b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-a9e078de-19b1-44d9-aaff-e1157f4dd52b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "cinder-quobyte-a9e078de-19b1-44d9-aaff-e1157f4dd52b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:53 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" returned: 0 in 0.329s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083c3a4-a080-426c-ac77-51ef849bd7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859f68a-0122-4a5f-a9a9-82565aa17213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-quobyte-a9e078de-19b1-44d9-aaff-e1157f4dd52b" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:53 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Volume volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c (f6278cf4-5f07-4732-ace6-0f0fbdf9792c): created successfully Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859f68a-0122-4a5f-a9a9-82565aa17213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Flow 'volume_create_manager' (2f112612-674a-4641-868c-25fb4f66c98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df881a-e8ce-434f-ae9c-e20fb61d8647]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c987dd2f-d687-4bc0-aee5-6c4f4593aaf8 tempest-VolumesTransfersV355Test-1339868604 None] Created volume successfully. Sep 03 13:39:53 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b Sep 03 13:39:53 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:53 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b" returned: 0 in 0.427s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:53 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b Sep 03 13:39:53 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:53 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9e078de-19b1-44d9-aaff-e1157f4dd52b" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-quobyte-a9e078de-19b1-44d9-aaff-e1157f4dd52b" released by "delete_volume" :: held 0.763s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Created reservations ['eafb4d89-4736-4258-a06b-796a32aa5931', 'a70b14c2-484b-4db7-8a54-ff2c54c3b8e4', 'd23398d9-a3db-42ee-8094-83610234e0da', '50674acf-64dd-484a-95e9-c015bf9d3af3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:54 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:54 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:54 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Deleted volume successfully. Sep 03 13:39:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-222cd7c7-0fb5-4797-89f7-eec7c9434cb8 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-a9e078de-19b1-44d9-aaff-e1157f4dd52b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6facc04f-5021-449d-b97a-081fa67e3083 tempest-VolumesTransfersV355Test-1411549257 None] Transfer volume completed successfully. Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Flow 'volume_create_manager' (18cc0ced-1fb5-440f-9639-59ca322c575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968508d6-aa5b-43f6-9db3-1f1cd4d2a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968508d6-aa5b-43f6-9db3-1f1cd4d2a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1704824443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3485401f-6373-475c-9dcd-e716688d859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f4e01db6b248d5b810da085f6dd38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:55Z,use_quota=True,user_id='d680e2f3918e4be3b7b401292c8546da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f994f7-e322-46a1-a530-f87c70fe6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f994f7-e322-46a1-a530-f87c70fe6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0036b9c-46ba-4276-b973-b8e92f4b3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0036b9c-46ba-4276-b973-b8e92f4b3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3485401f-6373-475c-9dcd-e716688d859f', 'volume_name': 'volume-3485401f-6373-475c-9dcd-e716688d859f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448a0a6-f977-49ea-9722-ab59d722132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448a0a6-f977-49ea-9722-ab59d722132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6f08ed-f09e-48ad-b584-f01fe6183f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Volume 3485401f-6373-475c-9dcd-e716688d859f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3485401f-6373-475c-9dcd-e716688d859f', 'volume_size': 1} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1704824443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3485401f-6373-475c-9dcd-e716688d859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f4e01db6b248d5b810da085f6dd38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:55Z,use_quota=True,user_id='d680e2f3918e4be3b7b401292c8546da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Creating volume 3485401f-6373-475c-9dcd-e716688d859f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:55 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:55 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f 1073741824 Sep 03 13:39:55 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "cinder-f6278cf4-5f07-4732-ace6-0f0fbdf9792c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:55 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f 1073741824" returned: 0 in 0.560s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-f6278cf4-5f07-4732-ace6-0f0fbdf9792c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "cinder-quobyte-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-quobyte-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:55 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f Sep 03 13:39:55 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cc8a9c-d32b-4266-aab7-0fb3895a2007]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:56 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c Sep 03 13:39:56 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:56 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f" returned: 0 in 0.372s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6f08ed-f09e-48ad-b584-f01fe6183f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3485401f-6373-475c-9dcd-e716688d859f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a63f816-73cf-4cb3-a990-eb05d37768e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Volume volume-3485401f-6373-475c-9dcd-e716688d859f (3485401f-6373-475c-9dcd-e716688d859f): created successfully Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a63f816-73cf-4cb3-a990-eb05d37768e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Flow 'volume_create_manager' (18cc0ced-1fb5-440f-9639-59ca322c575b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1250630f-ea39-4a36-b8a0-aec49c655072 tempest-VolumesTransfersV357Test-65153545 None] Created volume successfully. Sep 03 13:39:56 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" returned: 0 in 0.509s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:56 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c Sep 03 13:39:56 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:56 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-quobyte-f6278cf4-5f07-4732-ace6-0f0fbdf9792c" released by "delete_volume" :: held 0.822s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Created reservations ['6f4758c9-2e49-4049-97f4-0376e5db5d2f', 'c06f55ea-520b-4049-8baa-b9b9aab1e4f9', '7408951d-b862-425c-8974-d3740560cded', 'afd0de3d-20b3-4bd0-8ddc-da4350a8730d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:56 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:56 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:57 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Deleted volume successfully. Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b3b7c4c5-2972-4af0-bc5b-b491a5fff7bd tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-f6278cf4-5f07-4732-ace6-0f0fbdf9792c-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Flow 'volume_create_manager' (39fbbb16-27e6-4492-9610-f876c6f8b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b410c05-126e-4813-a8e9-a5d63af755fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b410c05-126e-4813-a8e9-a5d63af755fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-552229906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888e4158-3467-4b80-aae3-3585638abf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ce04293e964407a82c70e8b81fa3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:57Z,use_quota=True,user_id='83e791d959ec48dfbdae479acc06ee55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeeab10a-5ff2-432b-9604-2e484d91a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeeab10a-5ff2-432b-9604-2e484d91a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91272062-25e4-47e0-a380-592ba05a5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91272062-25e4-47e0-a380-592ba05a5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888e4158-3467-4b80-aae3-3585638abf17', 'volume_name': 'volume-888e4158-3467-4b80-aae3-3585638abf17', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946675d-81c4-4c81-b491-fdbc2981a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946675d-81c4-4c81-b491-fdbc2981a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7dc3b-dad6-427f-acfb-74500e1e60b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Volume 888e4158-3467-4b80-aae3-3585638abf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888e4158-3467-4b80-aae3-3585638abf17', 'volume_size': 1} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-552229906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888e4158-3467-4b80-aae3-3585638abf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ce04293e964407a82c70e8b81fa3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:39:57Z,use_quota=True,user_id='83e791d959ec48dfbdae479acc06ee55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Creating volume 888e4158-3467-4b80-aae3-3585638abf17 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:39:57 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "cinder-3485401f-6373-475c-9dcd-e716688d859f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:57 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 1073741824 Sep 03 13:39:57 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-3485401f-6373-475c-9dcd-e716688d859f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "cinder-quobyte-3485401f-6373-475c-9dcd-e716688d859f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-quobyte-3485401f-6373-475c-9dcd-e716688d859f" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7962ec1-3887-4052-969b-e983e873479f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:39:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:57 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f Sep 03 13:39:57 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:58 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 1073741824" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:58 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 Sep 03 13:39:58 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:58 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f" returned: 0 in 0.414s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:58 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f Sep 03 13:39:58 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:58 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7dc3b-dad6-427f-acfb-74500e1e60b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888e4158-3467-4b80-aae3-3585638abf17', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa323f5-a415-4517-88a6-b784c25eb6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:39:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Volume volume-888e4158-3467-4b80-aae3-3585638abf17 (888e4158-3467-4b80-aae3-3585638abf17): created successfully Sep 03 13:39:58 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa323f5-a415-4517-88a6-b784c25eb6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Flow 'volume_create_manager' (39fbbb16-27e6-4492-9610-f876c6f8b667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3485401f-6373-475c-9dcd-e716688d859f" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b1b512d4-999e-46ec-b578-08d0e07d0c6c tempest-VolumesTransfersV355Test-1339868604 None] Created volume successfully. Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-quobyte-3485401f-6373-475c-9dcd-e716688d859f" released by "delete_volume" :: held 0.747s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Created reservations ['6b15724e-49e8-4705-a25f-cb580c7f979c', '5e204b56-f718-45ea-9eb8-78b6f7112bce', 'e3f38729-19f1-46b6-a622-d168f4489693', '10735419-9d68-4d42-aef2-9fc271594528'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:39:58 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:39:58 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:39:58 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:39:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Deleted volume successfully. Sep 03 13:39:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2aac6870-47a0-4dbe-b6b4-3f80ceef5cf2 tempest-VolumesTransfersV357Test-1301985431 None] Lock "cinder-3485401f-6373-475c-9dcd-e716688d859f-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:39:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "cinder-888e4158-3467-4b80-aae3-3585638abf17-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:39:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-888e4158-3467-4b80-aae3-3585638abf17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "cinder-quobyte-888e4158-3467-4b80-aae3-3585638abf17" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-quobyte-888e4158-3467-4b80-aae3-3585638abf17" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fda07a-7a3c-4598-954c-a9a8261f0e05]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:00 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 Sep 03 13:40:00 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:00 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17" returned: 0 in 0.424s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:00 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17 Sep 03 13:40:00 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:00 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-888e4158-3467-4b80-aae3-3585638abf17" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-quobyte-888e4158-3467-4b80-aae3-3585638abf17" released by "delete_volume" :: held 0.806s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:00 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Created reservations ['35bacadd-abca-41bf-90a0-9194cd042fa3', 'c4cea9d1-b44d-4a40-9d98-7745d0d4d411', '29e149f8-06b3-42cb-878f-0a70aae08f8c', 'c9902012-3ce2-4324-9383-ce359c8e210a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:01 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:01 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:01 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.473s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Deleted volume successfully. Sep 03 13:40:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34686edf-0609-4444-8a4c-0f0eed6439bf tempest-VolumesTransfersV355Test-1153917582 None] Lock "cinder-888e4158-3467-4b80-aae3-3585638abf17-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-9e5c2833-6aac-4d78-8c58-1b417620abf6 tempest-TestShelveInstance-1055945598 None] Terminate volume connection completed successfully. Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-9e5c2833-6aac-4d78-8c58-1b417620abf6 tempest-TestShelveInstance-1055945598 None] Deleting attachment 05d36db6-1bd3-4c73-aac6-770ca0c6e4c5. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Acquiring lock "cinder-955e764a-da89-489a-bb50-e2cadd1589e4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "cinder-955e764a-da89-489a-bb50-e2cadd1589e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Acquiring lock "cinder-quobyte-955e764a-da89-489a-bb50-e2cadd1589e4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "cinder-quobyte-955e764a-da89-489a-bb50-e2cadd1589e4" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4a529-cd78-478e-9564-490f3c1bafc6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:05 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 Sep 03 13:40:05 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:06 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4" returned: 0 in 0.522s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:06 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4 Sep 03 13:40:06 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:06 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-955e764a-da89-489a-bb50-e2cadd1589e4" returned: 0 in 0.318s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "cinder-quobyte-955e764a-da89-489a-bb50-e2cadd1589e4" released by "delete_volume" :: held 0.902s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG cinder.quota [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Created reservations ['433b82ea-bd2c-4280-93e2-c1a3ea50609d', 'a9e362f6-9f3b-4488-aa73-467bdf3b5ffe', 'dc546d9b-239e-4dd3-87ac-5099249ac2cb', 'f109b154-0aa1-47b2-bf07-f6383940a1e9'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:06 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:06 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:07 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.332s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:07 devstack cinder-volume[86933]: DEBUG cinder.manager [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Deleted volume successfully. Sep 03 13:40:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-75dae4f2-09b0-49da-a53e-cc9c6d8da05a req-772c16a7-4425-41b7-899c-1c9252f83c30 tempest-TestShelveInstance-1055945598 None] Lock "cinder-955e764a-da89-489a-bb50-e2cadd1589e4-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (b5505b55-a298-481f-8810-6241ed97393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be35823c-7c19-4872-b0df-1a74a78d5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be35823c-7c19-4872-b0df-1a74a78d5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-512244755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6246580-d6ab-4161-b7a9-debf136326a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:10Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2a32ee-0172-4242-8265-b27903933c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2a32ee-0172-4242-8265-b27903933c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4eaace-10a2-4f54-bd9b-0a02d0a40f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4eaace-10a2-4f54-bd9b-0a02d0a40f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6246580-d6ab-4161-b7a9-debf136326a8', 'volume_name': 'volume-b6246580-d6ab-4161-b7a9-debf136326a8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e29ff5e-0808-47ba-82e6-4d6ff02e9249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e29ff5e-0808-47ba-82e6-4d6ff02e9249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477fa293-70d0-43ab-b983-19dd82d991f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Volume b6246580-d6ab-4161-b7a9-debf136326a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6246580-d6ab-4161-b7a9-debf136326a8', 'volume_size': 1} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-512244755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6246580-d6ab-4161-b7a9-debf136326a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:10Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Creating volume b6246580-d6ab-4161-b7a9-debf136326a8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:10 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:10 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 1073741824 Sep 03 13:40:10 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:11 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 1073741824" returned: 0 in 0.611s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:11 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 Sep 03 13:40:11 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:11 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477fa293-70d0-43ab-b983-19dd82d991f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6246580-d6ab-4161-b7a9-debf136326a8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf284bf5-9628-4790-a2f0-8c41bb8a355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:11 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Volume volume-b6246580-d6ab-4161-b7a9-debf136326a8 (b6246580-d6ab-4161-b7a9-debf136326a8): created successfully Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf284bf5-9628-4790-a2f0-8c41bb8a355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (b5505b55-a298-481f-8810-6241ed97393f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9dadaddf-243b-4acc-8cb4-8537f5d856b8 tempest-VolumesListTestJSON-746142136 None] Created volume successfully. Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (77b3ddb0-ddf5-48fa-adbd-bcaafb7a7987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7dbf94-23a2-4f52-bc97-850ca434c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7dbf94-23a2-4f52-bc97-850ca434c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-634781975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb51fdc-25a7-4984-82c8-10304e7f9cdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:13Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ac90f-9216-45ed-a200-1dffc9e43139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ac90f-9216-45ed-a200-1dffc9e43139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698e9710-1614-49fc-a4c3-51a74da1e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698e9710-1614-49fc-a4c3-51a74da1e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb51fdc-25a7-4984-82c8-10304e7f9cdd', 'volume_name': 'volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ef7c1b-f358-4380-9672-62c0dde64a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ef7c1b-f358-4380-9672-62c0dde64a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a5a209-03d1-4119-bed6-d06f92873ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:13 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Volume aeb51fdc-25a7-4984-82c8-10304e7f9cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd', 'volume_size': 1} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-634781975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb51fdc-25a7-4984-82c8-10304e7f9cdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:13Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Creating volume aeb51fdc-25a7-4984-82c8-10304e7f9cdd {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:13 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:13 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd 1073741824 Sep 03 13:40:13 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:13 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd 1073741824" returned: 0 in 0.534s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:14 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd Sep 03 13:40:14 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:14 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" returned: 0 in 0.396s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a5a209-03d1-4119-bed6-d06f92873ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cadda-add6-42d4-bcad-90200d694f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Volume volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd (aeb51fdc-25a7-4984-82c8-10304e7f9cdd): created successfully Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cadda-add6-42d4-bcad-90200d694f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (77b3ddb0-ddf5-48fa-adbd-bcaafb7a7987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8d8e6ae8-e4af-4011-96ee-62af6145c079 tempest-VolumesListTestJSON-746142136 None] Created volume successfully. Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (24dc1543-3e5b-475f-a6bd-859567987093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea4baf5-ebae-4172-90d9-6102fe43491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea4baf5-ebae-4172-90d9-6102fe43491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2019817696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29424e45-655f-4ea9-9370-618906ac2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:16Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ca63b8-51dc-491e-a9b8-5b0d25b4d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ca63b8-51dc-491e-a9b8-5b0d25b4d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cde2918-2e7c-43dc-9814-5cfc5eff0de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cde2918-2e7c-43dc-9814-5cfc5eff0de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29424e45-655f-4ea9-9370-618906ac2be6', 'volume_name': 'volume-29424e45-655f-4ea9-9370-618906ac2be6', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5ee91-4e52-47a6-a34c-ae30dd2aca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5ee91-4e52-47a6-a34c-ae30dd2aca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8076356-5feb-4647-8318-9f171658c18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:15 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Volume 29424e45-655f-4ea9-9370-618906ac2be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29424e45-655f-4ea9-9370-618906ac2be6', 'volume_size': 1} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2019817696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29424e45-655f-4ea9-9370-618906ac2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:16Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Creating volume 29424e45-655f-4ea9-9370-618906ac2be6 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:16 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:16 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 1073741824 Sep 03 13:40:16 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (423a24c3-d1c9-427b-88f2-7d2eefb0c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2173ad43-bd9b-40f2-8f61-293b2fc61578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2173ad43-bd9b-40f2-8f61-293b2fc61578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343006793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e88d6a5-cc0a-4807-a55a-188c6688ef5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:16Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef91d9-482a-4ebc-b595-77fb0dc7be53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef91d9-482a-4ebc-b595-77fb0dc7be53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944896ad-92d8-475f-a193-e8f3f2bb19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944896ad-92d8-475f-a193-e8f3f2bb19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e88d6a5-cc0a-4807-a55a-188c6688ef5d', 'volume_name': 'volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fe08a4-01ce-4e7f-85f5-8415a3a305b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fe08a4-01ce-4e7f-85f5-8415a3a305b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd11ea20-3a42-4df4-9bd5-e682c098dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:16 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Volume 1e88d6a5-cc0a-4807-a55a-188c6688ef5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d', 'volume_size': 1} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:16 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 1073741824" returned: 0 in 0.623s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:16 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 Sep 03 13:40:16 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:16 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343006793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e88d6a5-cc0a-4807-a55a-188c6688ef5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92cd8841f4244d6480e12a97145107ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:16Z,use_quota=True,user_id='b39db58a728745d687b8c591bf684d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Creating volume 1e88d6a5-cc0a-4807-a55a-188c6688ef5d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:16 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8076356-5feb-4647-8318-9f171658c18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29424e45-655f-4ea9-9370-618906ac2be6', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93482c75-a9d5-4717-b107-d1271e84065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:17 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d 1073741824 Sep 03 13:40:17 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:17 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Volume volume-29424e45-655f-4ea9-9370-618906ac2be6 (29424e45-655f-4ea9-9370-618906ac2be6): created successfully Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93482c75-a9d5-4717-b107-d1271e84065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (24dc1543-3e5b-475f-a6bd-859567987093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-49d13ac2-57bf-4446-a3f3-4ce3e97a69f3 tempest-AttachVolumeTestJSON-782672214 None] Created volume successfully. Sep 03 13:40:17 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d 1073741824" returned: 0 in 0.655s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:17 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d Sep 03 13:40:17 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:18 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd11ea20-3a42-4df4-9bd5-e682c098dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1344be-cb87-4c33-bfca-4ccb7c5c52f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:18 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Volume volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d (1e88d6a5-cc0a-4807-a55a-188c6688ef5d): created successfully Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1344be-cb87-4c33-bfca-4ccb7c5c52f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Flow 'volume_create_manager' (423a24c3-d1c9-427b-88f2-7d2eefb0c14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-276a2a7a-774a-4d19-acbe-517521448a44 tempest-VolumesListTestJSON-746142136 None] Created volume successfully. Sep 03 13:40:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d59bf3f1-837e-4ae5-92a3-17bdecefdb9a req-3a2a7b7b-8ea6-4d69-9930-2d85764ddb80 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d59bf3f1-837e-4ae5-92a3-17bdecefdb9a req-3a2a7b7b-8ea6-4d69-9930-2d85764ddb80 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-d59bf3f1-837e-4ae5-92a3-17bdecefdb9a req-3a2a7b7b-8ea6-4d69-9930-2d85764ddb80 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-d59bf3f1-837e-4ae5-92a3-17bdecefdb9a req-3a2a7b7b-8ea6-4d69-9930-2d85764ddb80 tempest-AttachVolumeTestJSON-782672214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-29424e45-655f-4ea9-9370-618906ac2be6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd496ceee-d204-4cca-b3b5-3b7f23b8ed88', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:40:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-d59bf3f1-837e-4ae5-92a3-17bdecefdb9a req-3a2a7b7b-8ea6-4d69-9930-2d85764ddb80 tempest-AttachVolumeTestJSON-782672214 None] attachment_update completed successfully. Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-1e88d6a5-cc0a-4807-a55a-188c6688ef5d-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "cinder-1e88d6a5-cc0a-4807-a55a-188c6688ef5d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-quobyte-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" acquired by "delete_volume" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc6b17f-9816-44df-9715-a2b5ba82081f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:21 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d Sep 03 13:40:21 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (cf2e4c5b-86cc-42e0-a769-e3e287a56b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8870c13e-ef2b-4a23-aa6e-aff0cc467db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8870c13e-ef2b-4a23-aa6e-aff0cc467db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-160129450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37483d75-52fa-4e9e-9c4b-31a7c53c078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:22Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e774c7-adde-4b84-97eb-43396637be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e774c7-adde-4b84-97eb-43396637be25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530cc51f-6f7f-45b1-8593-517bec3cb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530cc51f-6f7f-45b1-8593-517bec3cb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37483d75-52fa-4e9e-9c4b-31a7c53c078b', 'volume_name': 'volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a88c1f-65ce-440f-a8e3-e4fb5f4d23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a88c1f-65ce-440f-a8e3-e4fb5f4d23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f1a712-5207-4445-a698-52c4a6ec0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Volume 37483d75-52fa-4e9e-9c4b-31a7c53c078b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b', 'volume_size': 1} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-160129450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37483d75-52fa-4e9e-9c4b-31a7c53c078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1b11db4eb4ffa9c67d7c80ff74e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:22Z,use_quota=True,user_id='7a05454b19314f178e9f63801ea12dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Creating volume 37483d75-52fa-4e9e-9c4b-31a7c53c078b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:22 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:22 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b 1073741824 Sep 03 13:40:22 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:22 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" returned: 0 in 0.523s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:22 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d Sep 03 13:40:22 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:22 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" returned: 0 in 0.384s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-1e88d6a5-cc0a-4807-a55a-188c6688ef5d" released by "delete_volume" :: held 0.967s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:22 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Flow 'volume_create_manager' (03b0f3ea-5741-4829-8eea-973e6f8b8d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e322570-deaf-47e8-bf67-91a5112ec223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b 1073741824" returned: 0 in 0.642s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e322570-deaf-47e8-bf67-91a5112ec223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645172203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057e898-60ca-424a-85f4-e2d063de8f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95ba3e0a3014f4eac56c5d13f783e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:23Z,use_quota=True,user_id='6a291e35e1ad4b1ab9ae566acec96f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3292841f-5cb0-48a7-93e9-58dd1254a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3292841f-5cb0-48a7-93e9-58dd1254a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1574d4-a33a-4948-bc7e-7787ed4304de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1574d4-a33a-4948-bc7e-7787ed4304de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f057e898-60ca-424a-85f4-e2d063de8f3f', 'volume_name': 'volume-f057e898-60ca-424a-85f4-e2d063de8f3f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb56109-18f3-45e7-b01d-baefa6456a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb56109-18f3-45e7-b01d-baefa6456a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc82cf9-0fc3-4374-814f-f6e569aeafb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:22 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Volume f057e898-60ca-424a-85f4-e2d063de8f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f057e898-60ca-424a-85f4-e2d063de8f3f', 'volume_size': 1} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Created reservations ['7e2aae24-3fa4-4440-a85a-3ba91cf4dfb5', 'd3682f4c-7ce9-4d60-9c03-193c7b9be32e', 'e1ce11d7-633d-4de6-882e-874d35ba5158', '54f3b0f0-f68e-491c-a2f4-122db4f8aab4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:22 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b Sep 03 13:40:22 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:23 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:23 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:23 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645172203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057e898-60ca-424a-85f4-e2d063de8f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95ba3e0a3014f4eac56c5d13f783e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:23Z,use_quota=True,user_id='6a291e35e1ad4b1ab9ae566acec96f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Creating volume f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:23 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f1a712-5207-4445-a698-52c4a6ec0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4afefaa-c97b-40d9-b310-427e858d15fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:23 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f 1073741824 Sep 03 13:40:23 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:23 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Volume volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b (37483d75-52fa-4e9e-9c4b-31a7c53c078b): created successfully Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4afefaa-c97b-40d9-b310-427e858d15fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:23 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Flow 'volume_create_manager' (cf2e4c5b-86cc-42e0-a769-e3e287a56b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.336s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Deleted volume successfully. Sep 03 13:40:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f60c9165-834c-4f62-9c1a-19a89b7b41fa tempest-AttachVolumeTestJSON-782672214 None] Created volume successfully. Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bd41dfde-c996-452e-a791-9d9f0c3f906d tempest-VolumesListTestJSON-746142136 None] Lock "cinder-1e88d6a5-cc0a-4807-a55a-188c6688ef5d-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:23 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f 1073741824" returned: 0 in 0.482s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:23 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:40:23 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-aeb51fdc-25a7-4984-82c8-10304e7f9cdd-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "cinder-aeb51fdc-25a7-4984-82c8-10304e7f9cdd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:24 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-quobyte-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.287s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc82cf9-0fc3-4374-814f-f6e569aeafb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f057e898-60ca-424a-85f4-e2d063de8f3f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff491d50-49db-4b4a-9c45-716837b61812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" acquired by "delete_volume" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:24 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Volume volume-f057e898-60ca-424a-85f4-e2d063de8f3f (f057e898-60ca-424a-85f4-e2d063de8f3f): created successfully Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff491d50-49db-4b4a-9c45-716837b61812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Flow 'volume_create_manager' (03b0f3ea-5741-4829-8eea-973e6f8b8d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[074a3895-40ab-4d15-8b0d-bcb8d3ba6c5c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-66f70aea-ad9a-4194-a1f1-6ace4583dc83 tempest-VolumesActionsTest-1455620956 None] Created volume successfully. Sep 03 13:40:24 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd Sep 03 13:40:24 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:24 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" returned: 0 in 0.394s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:24 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd Sep 03 13:40:24 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:24 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" returned: 0 in 0.329s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-aeb51fdc-25a7-4984-82c8-10304e7f9cdd" released by "delete_volume" :: held 0.789s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:24 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Created reservations ['b64be789-fd8f-485a-8f9c-f527d260a2b7', '60964984-c0d8-46d0-b366-13ef2c5ea081', 'fe0b0b61-88a9-43b7-9341-76ade2aa00d7', '578488b0-8db1-4f8a-8a0b-73d991374aa6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:25 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:25 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-b6246580-d6ab-4161-b7a9-debf136326a8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "cinder-b6246580-d6ab-4161-b7a9-debf136326a8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Acquiring lock "cinder-quobyte-b6246580-d6ab-4161-b7a9-debf136326a8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-b6246580-d6ab-4161-b7a9-debf136326a8" acquired by "delete_volume" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7bc57a-daec-4b19-987c-56a7951bbd6a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:25 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.524s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-47fcefee-cf1c-4671-8bc0-b5e7b7f5aa6e req-d3fc42be-a362-4a43-bc91-5a5c60615a96 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-47fcefee-cf1c-4671-8bc0-b5e7b7f5aa6e req-d3fc42be-a362-4a43-bc91-5a5c60615a96 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Deleted volume successfully. Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-47fcefee-cf1c-4671-8bc0-b5e7b7f5aa6e req-d3fc42be-a362-4a43-bc91-5a5c60615a96 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-123e9127-8c94-4dfb-a1c9-b2d15daf289a tempest-VolumesListTestJSON-746142136 None] Lock "cinder-aeb51fdc-25a7-4984-82c8-10304e7f9cdd-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-47fcefee-cf1c-4671-8bc0-b5e7b7f5aa6e req-d3fc42be-a362-4a43-bc91-5a5c60615a96 tempest-AttachVolumeTestJSON-782672214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0267b460-0bbc-4924-bc99-a13562830fbb', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:40:25 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 Sep 03 13:40:25 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-47fcefee-cf1c-4671-8bc0-b5e7b7f5aa6e req-d3fc42be-a362-4a43-bc91-5a5c60615a96 tempest-AttachVolumeTestJSON-782672214 None] attachment_update completed successfully. Sep 03 13:40:26 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8" returned: 0 in 0.768s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:26 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8 Sep 03 13:40:26 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:26 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b6246580-d6ab-4161-b7a9-debf136326a8" returned: 0 in 0.436s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "cinder-quobyte-b6246580-d6ab-4161-b7a9-debf136326a8" released by "delete_volume" :: held 1.287s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Created reservations ['61b3f8a3-f264-415c-8940-3f4350a786d3', '6c633941-5843-4829-8181-c3a4c271a0a1', 'f0e0a559-bc62-4c83-9889-8eb4fa2444eb', '178e69f8-ea46-45e7-94df-9842b100d7d0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:27 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:27 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:27 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:27 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Deleted volume successfully. Sep 03 13:40:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fb9c2175-645b-4831-92b0-e2184f9b6ead tempest-VolumesListTestJSON-746142136 None] Lock "cinder-b6246580-d6ab-4161-b7a9-debf136326a8-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-ec3e349d-3136-4749-93a1-7c54fd9bf3cd req-e1e27203-cfd6-49ee-a360-f37412447d72 tempest-AttachVolumeTestJSON-782672214 None] Terminate volume connection completed successfully. Sep 03 13:40:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-ec3e349d-3136-4749-93a1-7c54fd9bf3cd req-e1e27203-cfd6-49ee-a360-f37412447d72 tempest-AttachVolumeTestJSON-782672214 None] Deleting attachment d496ceee-d204-4cca-b3b5-3b7f23b8ed88. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:40:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-cdb227e8-92c4-4e59-83ea-208df446ad13 req-3ee3e09a-8405-4a5e-9e40-9f6d56bff959 tempest-AttachVolumeTestJSON-782672214 None] Terminate volume connection completed successfully. Sep 03 13:40:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-cdb227e8-92c4-4e59-83ea-208df446ad13 req-3ee3e09a-8405-4a5e-9e40-9f6d56bff959 tempest-AttachVolumeTestJSON-782672214 None] Deleting attachment 0267b460-0bbc-4924-bc99-a13562830fbb. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:33 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:33 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:33 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.329s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:40:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:40:40 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=103,cinder:UPDATE=124,cinder:INSERT=32,cinder:DELETE=15 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:40:40 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=99,cinder:UPDATE=140,cinder:INSERT=28,cinder:DELETE=8 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-37483d75-52fa-4e9e-9c4b-31a7c53c078b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-37483d75-52fa-4e9e-9c4b-31a7c53c078b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-quobyte-37483d75-52fa-4e9e-9c4b-31a7c53c078b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-37483d75-52fa-4e9e-9c4b-31a7c53c078b" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2361d-682f-42a2-a7f0-ed48d4edc572]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:42 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b Sep 03 13:40:42 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:43 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b" returned: 0 in 0.447s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:43 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b Sep 03 13:40:43 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:43 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-37483d75-52fa-4e9e-9c4b-31a7c53c078b" returned: 0 in 0.295s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-37483d75-52fa-4e9e-9c4b-31a7c53c078b" released by "delete_volume" :: held 0.792s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Created reservations ['62263f69-1e38-49a1-b29d-b8aaec7aedb7', 'd39b4967-d827-42c9-a6e5-c5fb6c1d29b0', '322b50ef-f84c-4043-ba18-cfa9985be390', 'fae82fff-0d40-47f4-833b-7163c0a17784'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:43 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:43 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-29424e45-655f-4ea9-9370-618906ac2be6-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-29424e45-655f-4ea9-9370-618906ac2be6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-quobyte-29424e45-655f-4ea9-9370-618906ac2be6" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-29424e45-655f-4ea9-9370-618906ac2be6" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da281ab-bcff-4db9-b776-4f1abd0f9b1b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:44 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.429s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Deleted volume successfully. Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-44f75436-ae87-44f4-a990-7de73441232d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-37483d75-52fa-4e9e-9c4b-31a7c53c078b-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:44 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 Sep 03 13:40:44 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:44 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6" returned: 0 in 0.564s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:44 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6 Sep 03 13:40:44 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:44 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-29424e45-655f-4ea9-9370-618906ac2be6" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-29424e45-655f-4ea9-9370-618906ac2be6" released by "delete_volume" :: held 0.913s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Created reservations ['cbf9c4db-3fe4-49c0-92f9-05aa195e8b8b', '281706da-0386-4795-bbb5-b01cc94649d5', '7ab60d75-f869-4cba-9f78-20b4a5a01e33', '9f26612a-326b-43df-ae18-61eba536b19f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:45 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:45 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-da6477f9-0b50-44f4-8de9-9f23a4410062-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-da6477f9-0b50-44f4-8de9-9f23a4410062-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "cinder-quobyte-da6477f9-0b50-44f4-8de9-9f23a4410062" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-da6477f9-0b50-44f4-8de9-9f23a4410062" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dae110-4dd6-49cd-831b-bf2c4d5f3291]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:45 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.643s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Deleted volume successfully. Sep 03 13:40:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-efcf524e-095c-430d-8325-b75cd8a029a3 tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-29424e45-655f-4ea9-9370-618906ac2be6-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:45 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 Sep 03 13:40:45 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:46 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062" returned: 0 in 0.738s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:46 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062 Sep 03 13:40:46 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:46 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-da6477f9-0b50-44f4-8de9-9f23a4410062" returned: 0 in 0.401s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-quobyte-da6477f9-0b50-44f4-8de9-9f23a4410062" released by "delete_volume" :: held 1.210s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Created reservations ['1544aa51-c4f7-43c1-b2b2-fc556edebdce', 'cdb3d18b-ce22-49cc-ab32-03dfbd8b4998', 'b139975e-7ec7-40d6-b6c3-7d90664a2ec5', '8b1e6d84-2453-4df7-b8fa-f155e436ae98'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:47 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:40:47 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:47 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:40:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Deleted volume successfully. Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c86cf5ea-561a-4bd1-8b5f-5f3d30fc093d tempest-AttachVolumeTestJSON-782672214 None] Lock "cinder-da6477f9-0b50-44f4-8de9-9f23a4410062-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (7d32b663-e275-445f-a171-bb7669fe004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cff88d-3ee8-4789-a996-ed5252d5273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cff88d-3ee8-4789-a996-ed5252d5273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1033881203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0ed883-36e9-4220-91a1-5267e813ce3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:47Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0f37a-264d-411a-a4d7-ba396672ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0f37a-264d-411a-a4d7-ba396672ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d6cbe0-3292-4c87-a662-315ae557e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d6cbe0-3292-4c87-a662-315ae557e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0ed883-36e9-4220-91a1-5267e813ce3d', 'volume_name': 'volume-9d0ed883-36e9-4220-91a1-5267e813ce3d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa65a60-189c-4f5c-9e84-c30136c96703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa65a60-189c-4f5c-9e84-c30136c96703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bd7930-fa84-45b4-8c8d-38e4702a1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Volume 9d0ed883-36e9-4220-91a1-5267e813ce3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0ed883-36e9-4220-91a1-5267e813ce3d', 'volume_size': 1} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1033881203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0ed883-36e9-4220-91a1-5267e813ce3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:47Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Creating volume 9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:47 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:47 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d 1073741824 Sep 03 13:40:47 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-00780883-90ce-4799-acdc-94278a03e195 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" by "attach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-00780883-90ce-4799-acdc-94278a03e195 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" acquired by "attach_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-00780883-90ce-4799-acdc-94278a03e195 tempest-VolumesActionsTest-1455620956 None] Attaching volume f057e898-60ca-424a-85f4-e2d063de8f3f to instance 50ed46ff-a23f-47a6-ae69-25909934b13b at mountpoint /dev/vdb on host None. Sep 03 13:40:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-00780883-90ce-4799-acdc-94278a03e195 tempest-VolumesActionsTest-1455620956 None] Attach volume completed successfully. Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-00780883-90ce-4799-acdc-94278a03e195 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" released by "attach_volume" :: held 0.210s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16cae822-f1a3-4846-955b-bb8cc0fa034a tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" by "detach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16cae822-f1a3-4846-955b-bb8cc0fa034a tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-16cae822-f1a3-4846-955b-bb8cc0fa034a tempest-VolumesActionsTest-1455620956 None] Detaching volume f057e898-60ca-424a-85f4-e2d063de8f3f from instance 50ed46ff-a23f-47a6-ae69-25909934b13b. Sep 03 13:40:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-16cae822-f1a3-4846-955b-bb8cc0fa034a tempest-VolumesActionsTest-1455620956 None] Detach volume completed successfully. Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16cae822-f1a3-4846-955b-bb8cc0fa034a tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:48 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d 1073741824" returned: 0 in 0.953s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:48 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d Sep 03 13:40:48 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:49 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d" returned: 0 in 0.537s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bd7930-fa84-45b4-8c8d-38e4702a1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0ed883-36e9-4220-91a1-5267e813ce3d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39267633-3a71-47fc-a8a8-8f1168cdce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Volume volume-9d0ed883-36e9-4220-91a1-5267e813ce3d (9d0ed883-36e9-4220-91a1-5267e813ce3d): created successfully Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39267633-3a71-47fc-a8a8-8f1168cdce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (7d32b663-e275-445f-a171-bb7669fe004e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-555b63fd-101e-4a6c-a14d-d1322ddc7549 tempest-VolumesSnapshotTestJSON-33111012 None] Created volume successfully. Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Creating offline snapshot 9a1d8990-d189-4ded-b46b-4113d74f13e5 of volume 9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff46c6c-518f-4f16-aad9-48b173b9ead6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:50 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d Sep 03 13:40:50 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:50 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:50 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 1G Sep 03 13:40:50 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:50 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 1G" returned: 0 in 0.454s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0ed883-36e9-4220-91a1-5267e813ce3d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:50 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0ed883-36e9-4220-91a1-5267e813ce3d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 Sep 03 13:40:50 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:51 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0ed883-36e9-4220-91a1-5267e813ce3d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:51 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 is being set with open permissions: ugo+rw Sep 03 13:40:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:51 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 Sep 03 13:40:51 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:51 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:51 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info Sep 03 13:40:51 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:52 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info" returned: 0 in 0.305s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:52 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info is being set with open permissions: ugo+rw Sep 03 13:40:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:52 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info Sep 03 13:40:52 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:52 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.info" returned: 0 in 0.376s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c3292d51-d80d-47be-82fe-f63e30a78d35 tempest-VolumesSnapshotTestJSON-33111012 None] Create snapshot completed successfully Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-9a1d8990-d189-4ded-b46b-4113d74f13e5-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-9a1d8990-d189-4ded-b46b-4113d74f13e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-9a1d8990-d189-4ded-b46b-4113d74f13e5" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9a1d8990-d189-4ded-b46b-4113d74f13e5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Deleting offline snapshot 9a1d8990-d189-4ded-b46b-4113d74f13e5 of volume 9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] snapshot_file for this snap is: volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aadcea-28b1-4e6d-bf44-2f3eb6991d15]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:53 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 Sep 03 13:40:53 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:54 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5" returned: 0 in 0.428s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0ed883-36e9-4220-91a1-5267e813ce3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[982fa7f8-8b15-455c-b29f-a5c5c0c87c6b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:54 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d Sep 03 13:40:54 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:54 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d" returned: 0 in 0.498s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:54 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 Sep 03 13:40:54 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:55 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5" returned: 0 in 0.396s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:55 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5 Sep 03 13:40:55 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:55 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d.9a1d8990-d189-4ded-b46b-4113d74f13e5" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9a1d8990-d189-4ded-b46b-4113d74f13e5" released by "_delete_snapshot" :: held 1.774s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" released by "delete_snapshot" :: held 1.813s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['f2cd65cb-4673-4c53-8873-51d47a5f978b', '599ea9e8-4c2f-47be-a6b6-8c137b8e61f2', '5b32dec5-6db3-4e1e-9957-9dc6430bbccc', '7a277672-b9d4-4d29-9dc0-f50187c82dea'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:40:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Delete snapshot completed successfully. Sep 03 13:40:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-349c5c44-bf0f-4207-839c-f6a76457ccba tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-9a1d8990-d189-4ded-b46b-4113d74f13e5-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (414b7944-26ee-476f-8c6b-73bac10be1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db734c29-b3b7-4d20-9b8f-662e1fddeabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db734c29-b3b7-4d20-9b8f-662e1fddeabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-122618463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6d9a74-95df-4ffb-a610-ea9a50e742a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:56Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93d1ca5-9a75-4038-8833-3ebb1622f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93d1ca5-9a75-4038-8833-3ebb1622f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01fb5d2-0df8-47ec-94b6-ca55af4a8256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01fb5d2-0df8-47ec-94b6-ca55af4a8256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6d9a74-95df-4ffb-a610-ea9a50e742a4', 'volume_name': 'volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469b29bc-7c4c-4839-8867-ec4e91a237c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469b29bc-7c4c-4839-8867-ec4e91a237c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8086f49a-667f-46d3-beda-33f48cf56eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Volume de6d9a74-95df-4ffb-a610-ea9a50e742a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4', 'volume_size': 1} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-122618463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6d9a74-95df-4ffb-a610-ea9a50e742a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:40:56Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Creating volume de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:40:56 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:40:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:56 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 1073741824 Sep 03 13:40:56 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:57 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 1073741824" returned: 0 in 0.699s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:57 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:40:57 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:57 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 0.426s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8086f49a-667f-46d3-beda-33f48cf56eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6325a656-bd92-42d0-bc4d-73c9e866d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Volume volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 (de6d9a74-95df-4ffb-a610-ea9a50e742a4): created successfully Sep 03 13:40:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6325a656-bd92-42d0-bc4d-73c9e866d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (414b7944-26ee-476f-8c6b-73bac10be1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d61bed9c-895b-441e-be9f-10aa3d30c335 tempest-VolumesSnapshotTestJSON-33111012 None] Created volume successfully. Sep 03 13:40:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:40:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Creating offline snapshot 5c5179a6-e2c1-48d2-adbf-7d85edb2be2b of volume de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[33302dfd-396a-4480-83e2-156299b979a4]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:59 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:40:59 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:59 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 0.586s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:40:59 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b 1G Sep 03 13:40:59 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Flow 'volume_create_manager' (f78a25ed-0762-413c-8e52-8ba46ac24fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4341409a-c150-4d14-b76c-eda936387a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4341409a-c150-4d14-b76c-eda936387a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1698110488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a24a88-a936-4370-bd7f-479f4773efe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf41acab5364c87abea3d7195663957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:00Z,use_quota=True,user_id='e3306c0be6f3494aa54e98638a33d904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:40:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16a03c4-4512-4608-87a5-74e55a650d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16a03c4-4512-4608-87a5-74e55a650d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730b7366-d182-453f-bc01-cf2cb9f13455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730b7366-d182-453f-bc01-cf2cb9f13455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a24a88-a936-4370-bd7f-479f4773efe4', 'volume_name': 'volume-96a24a88-a936-4370-bd7f-479f4773efe4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d36006-b492-419b-a327-685c0ca07e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d36006-b492-419b-a327-685c0ca07e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e7c0f-6b1d-45d9-be6a-854dc693eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:00 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Volume 96a24a88-a936-4370-bd7f-479f4773efe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a24a88-a936-4370-bd7f-479f4773efe4', 'volume_size': 1} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:00 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b 1G" returned: 0 in 0.589s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:00 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:00 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:00 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:00 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b is being set with open permissions: ugo+rw Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:00 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:00 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:00 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 0.265s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:00 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info Sep 03 13:41:00 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Flow 'volume_create_manager' (c4ff6076-d959-4db3-8a20-67dc3f21419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47be4735-79f5-4a8f-a1a0-aa9d46d28a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47be4735-79f5-4a8f-a1a0-aa9d46d28a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-659728888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d5f7fc-23fe-4534-ae38-aeb6366c4107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb394a0b25fd40a1a49285505e6f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:01Z,use_quota=True,user_id='9be096ce14e34450807c79f76ca574ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941f74b8-acb2-488e-89e2-515061f72c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941f74b8-acb2-488e-89e2-515061f72c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d9a52d-74bd-4333-8a1e-7daf268bb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d9a52d-74bd-4333-8a1e-7daf268bb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d5f7fc-23fe-4534-ae38-aeb6366c4107', 'volume_name': 'volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6ba459-5aa0-4c98-896b-a1c333eb3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6ba459-5aa0-4c98-896b-a1c333eb3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bbb81b-8061-4d0b-8bfe-55878d224635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:01 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Volume 63d5f7fc-23fe-4534-ae38-aeb6366c4107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107', 'volume_size': 1} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:01 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info" returned: 0 in 0.351s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info is being set with open permissions: ugo+rw Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:01 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info Sep 03 13:41:01 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:01 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.info" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1698110488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a24a88-a936-4370-bd7f-479f4773efe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf41acab5364c87abea3d7195663957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:00Z,use_quota=True,user_id='e3306c0be6f3494aa54e98638a33d904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Creating volume 96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:41:01 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:41:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:01 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 1073741824 Sep 03 13:41:01 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f210c9b7-2338-4ced-a855-e27ed3e7b16e tempest-VolumesSnapshotTestJSON-33111012 None] Create snapshot completed successfully Sep 03 13:41:02 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 1073741824" returned: 0 in 0.495s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:02 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:02 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:02 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.453s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-659728888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d5f7fc-23fe-4534-ae38-aeb6366c4107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb394a0b25fd40a1a49285505e6f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:01Z,use_quota=True,user_id='9be096ce14e34450807c79f76ca574ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Creating volume 63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:41:02 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:02 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 1073741824 Sep 03 13:41:02 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e7c0f-6b1d-45d9-be6a-854dc693eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a24a88-a936-4370-bd7f-479f4773efe4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfec1f64-9856-48f9-a0b9-1c84149cf05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:02 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Volume volume-96a24a88-a936-4370-bd7f-479f4773efe4 (96a24a88-a936-4370-bd7f-479f4773efe4): created successfully Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfec1f64-9856-48f9-a0b9-1c84149cf05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:02 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Flow 'volume_create_manager' (f78a25ed-0762-413c-8e52-8ba46ac24fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-dcc133a3-ed2a-4ef0-b14b-4cfc2ce7203b tempest-TestImageHashVerification-1398509943 None] Created volume successfully. Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (5dfdfc49-09ea-4312-9d1e-da1dc03aa48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35df3b3-7daf-45bc-ba15-581dee9f14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35df3b3-7daf-45bc-ba15-581dee9f14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1137016236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e11009f-8747-4003-93a4-ae358f4fc70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5c5179a6-e2c1-48d2-adbf-7d85edb2be2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:03Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c5384f-8a44-41fc-80d4-e9a28fb9427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c5384f-8a44-41fc-80d4-e9a28fb9427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671ae000-f0f4-4109-99ff-758e48229784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671ae000-f0f4-4109-99ff-758e48229784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e11009f-8747-4003-93a4-ae358f4fc70f', 'volume_name': 'volume-8e11009f-8747-4003-93a4-ae358f4fc70f', 'volume_size': 2, 'snapshot_id': '5c5179a6-e2c1-48d2-adbf-7d85edb2be2b'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19145a80-92f1-45f4-961f-1c3854248f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19145a80-92f1-45f4-961f-1c3854248f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e743b02a-a83f-4215-9c0d-173fd5a57bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:03 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Volume 8e11009f-8747-4003-93a4-ae358f4fc70f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e11009f-8747-4003-93a4-ae358f4fc70f', 'volume_size': 2, 'snapshot_id': '5c5179a6-e2c1-48d2-adbf-7d85edb2be2b'} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 1073741824" returned: 0 in 1.069s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:03 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:03 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 Sep 03 13:41:03 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:04 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.673s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-8e11009f-8747-4003-93a4-ae358f4fc70f" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bbb81b-8061-4d0b-8bfe-55878d224635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c38b4-3563-48e4-805f-a3500f76d7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-8e11009f-8747-4003-93a4-ae358f4fc70f" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Creating volume 8e11009f-8747-4003-93a4-ae358f4fc70f from snapshot 5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Volume volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 (63d5f7fc-23fe-4534-ae38-aeb6366c4107): created successfully Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c38b4-3563-48e4-805f-a3500f76d7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Flow 'volume_create_manager' (c4ff6076-d959-4db3-8a20-67dc3f21419c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] snapshot: 5c5179a6-e2c1-48d2-adbf-7d85edb2be2b, volume: 8e11009f-8747-4003-93a4-ae358f4fc70f, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:41:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-0112fe8e-54e8-4c17-95ef-09447d37378e req-cbf86ce4-a89a-4f4b-b4ad-574f75c5ed0b tempest-VolumesSnapshotsTestJSON-2004857900 None] Created volume successfully. Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac59f6-cf30-4122-a2ff-ecea4047e2c9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:04 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:04 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:05 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 0.743s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c780c10e-06fa-4d6b-8473-0d5dacca1064]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:05 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:41:05 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:05 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 0.397s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:41:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:05 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f Sep 03 13:41:05 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9cf0b6fd-bad9-4c30-a8ea-adb47d3b7f34 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" by "attach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9cf0b6fd-bad9-4c30-a8ea-adb47d3b7f34 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" acquired by "attach_volume" :: waited 0.058s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9cf0b6fd-bad9-4c30-a8ea-adb47d3b7f34 tempest-VolumesActionsTest-1455620956 None] Attaching volume f057e898-60ca-424a-85f4-e2d063de8f3f to instance a53d3c51-dd31-4d8c-ba92-af6688f6a726 at mountpoint /dev/vdb on host None. Sep 03 13:41:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9cf0b6fd-bad9-4c30-a8ea-adb47d3b7f34 tempest-VolumesActionsTest-1455620956 None] Attach volume completed successfully. Sep 03 13:41:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9cf0b6fd-bad9-4c30-a8ea-adb47d3b7f34 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f" released by "attach_volume" :: held 0.319s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4b7ac0b6-b1f6-489c-b260-1b086655ad95 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" by "detach_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4b7ac0b6-b1f6-489c-b260-1b086655ad95 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4b7ac0b6-b1f6-489c-b260-1b086655ad95 tempest-VolumesActionsTest-1455620956 None] Detaching volume f057e898-60ca-424a-85f4-e2d063de8f3f from instance a53d3c51-dd31-4d8c-ba92-af6688f6a726. Sep 03 13:41:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4b7ac0b6-b1f6-489c-b260-1b086655ad95 tempest-VolumesActionsTest-1455620956 None] Detach volume completed successfully. Sep 03 13:41:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4b7ac0b6-b1f6-489c-b260-1b086655ad95 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:11 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f" returned: 0 in 6.172s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:11 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:41:11 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Converted 1024.00 MB image at 165.87 MB/s Sep 03 13:41:11 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f is being set with open permissions: ugo+rw Sep 03 13:41:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:11 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f Sep 03 13:41:11 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:12 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" released by "_copy_volume_from_snapshot" :: held 7.718s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-8e11009f-8747-4003-93a4-ae358f4fc70f" released by "_create_volume_from_snapshot" :: held 7.827s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.865s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.209s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805a21c-d603-429d-86de-01a85e68d823]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e743b02a-a83f-4215-9c0d-173fd5a57bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e11009f-8747-4003-93a4-ae358f4fc70f', 'volume_size': 2, 'snapshot_id': '5c5179a6-e2c1-48d2-adbf-7d85edb2be2b'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9eff12-e2c2-43cd-8515-e1f0b3248c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Volume volume-8e11009f-8747-4003-93a4-ae358f4fc70f (8e11009f-8747-4003-93a4-ae358f4fc70f): created successfully Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9eff12-e2c2-43cd-8515-e1f0b3248c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (5dfdfc49-09ea-4312-9d1e-da1dc03aa48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cc2fa721-b890-4494-b51f-b207ffa89ca2 tempest-VolumesSnapshotTestJSON-33111012 None] Created volume successfully. Sep 03 13:41:12 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:12 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-8e11009f-8747-4003-93a4-ae358f4fc70f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-8e11009f-8747-4003-93a4-ae358f4fc70f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2794c-ff20-4097-97a0-afb38f9d791d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:12 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c85c3-83d2-4481-a88f-c6ec276d12c0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:12 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f Sep 03 13:41:12 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:12 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:12 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:12 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:12 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f Sep 03 13:41:12 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:12 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 /opt/stack/data/cinder/conversion/96a24a88-a936-4370-bd7f-479f4773efe4.temp_image.28230efa-8b54-4579-83cb-c250f51afd25rt6rfjwm.img {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:12 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 /opt/stack/data/cinder/conversion/96a24a88-a936-4370-bd7f-479f4773efe4.temp_image.28230efa-8b54-4579-83cb-c250f51afd25rt6rfjwm.img Sep 03 13:41:12 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:13 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8e11009f-8747-4003-93a4-ae358f4fc70f" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-8e11009f-8747-4003-93a4-ae358f4fc70f" released by "delete_volume" :: held 0.692s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['596199cd-41d8-4c48-b281-adecfcc8a992', 'e52d0c8e-34dd-463a-a355-d27335941236', 'd9a717ee-7a55-49ec-a041-dbc1c4d60c96', '52c6773b-de13-4000-819e-53da821f88c6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:13 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:41:13 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:13 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.534s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:41:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Deleted volume successfully. Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76b56173-ffdd-4c63-8f31-28cfe7a3a23f tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-8e11009f-8747-4003-93a4-ae358f4fc70f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Deleting offline snapshot 5c5179a6-e2c1-48d2-adbf-7d85edb2be2b of volume de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] snapshot_file for this snap is: volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0e59d3-1a98-470d-b917-504492e18ed5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:14 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:14 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:15 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 1.128s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:41:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c70e54-84a5-4459-a56c-4a484fbbb660]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:15 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:41:15 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:16 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 1.549s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:16 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:16 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:17 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 0.737s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:17 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b Sep 03 13:41:17 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:18 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 /opt/stack/data/cinder/conversion/96a24a88-a936-4370-bd7f-479f4773efe4.temp_image.28230efa-8b54-4579-83cb-c250f51afd25rt6rfjwm.img" returned: 0 in 5.169s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1039d926-9fd7-4496-8efd-4bd39f25c5ff]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:18 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4.5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b" released by "_delete_snapshot" :: held 4.082s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" released by "delete_snapshot" :: held 4.149s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:18 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:18 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['e3e7a9b3-4b17-44b7-abb9-4e1cbc73f2fc', 'fe6025b6-d2e5-4359-9c2b-f3794b4c8a3b', '35a24b6b-a423-4990-9df3-94d6cd8dedc0', '729dee7e-05ef-42df-b9a7-71bd105ac9aa'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Delete snapshot completed successfully. Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a581e870-6f33-410a-97ca-b3809f203ad3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-5c5179a6-e2c1-48d2-adbf-7d85edb2be2b-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-de6d9a74-95df-4ffb-a610-ea9a50e742a4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-de6d9a74-95df-4ffb-a610-ea9a50e742a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f5b1b-6e40-424c-b36e-df2c4feca057]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:18 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.540s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/conversion/96a24a88-a936-4370-bd7f-479f4773efe4.temp_image.28230efa-8b54-4579-83cb-c250f51afd25rt6rfjwm.img {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:41:18 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Converted 1024.00 MB image at 198.07 MB/s Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] 28230efa-8b54-4579-83cb-c250f51afd25 was raw, no need to convert to raw {{(pid=86933) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 13:41:18 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:41:18 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:18 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 0.366s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:19 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4 Sep 03 13:41:19 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:19 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de6d9a74-95df-4ffb-a610-ea9a50e742a4" returned: 0 in 0.262s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-de6d9a74-95df-4ffb-a610-ea9a50e742a4" released by "delete_volume" :: held 0.690s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['eefa5e37-e03e-460f-8685-18f5a2b3c513', '3f50f772-f07c-4852-869d-9072a62c42e8', 'f2b3bc57-1bb3-47ff-bb7d-e9f901ea1931', '9b4e5928-1ab7-4ddc-b67e-7267264df7e6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:19 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:41:19 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:19 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.300s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:41:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Deleted volume successfully. Sep 03 13:41:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-101e0661-b157-4289-b237-dc2a351c5a33 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-de6d9a74-95df-4ffb-a610-ea9a50e742a4-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (1e64d95c-db8c-4f98-a493-43891c5c4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef630f5-04cb-4b53-886b-c57ab4cdecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef630f5-04cb-4b53-886b-c57ab4cdecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1743637040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbe4e66-db6a-4a61-8172-f491cc654533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:20Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3688765-54fb-4b6a-ba18-c4283f0d2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3688765-54fb-4b6a-ba18-c4283f0d2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed8c02d-6def-40ec-ac28-cf05485bcead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed8c02d-6def-40ec-ac28-cf05485bcead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbe4e66-db6a-4a61-8172-f491cc654533', 'volume_name': 'volume-5cbe4e66-db6a-4a61-8172-f491cc654533', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6fac24-cd95-42d2-9333-da9273b9fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6fac24-cd95-42d2-9333-da9273b9fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9f4cc1-29f6-48e8-b8c8-0d3ce76c4b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:20 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Volume 5cbe4e66-db6a-4a61-8172-f491cc654533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbe4e66-db6a-4a61-8172-f491cc654533', 'volume_size': 1} Sep 03 13:41:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:30 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=79,cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:41:30 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=70,cinder:INSERT=16,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:33 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:41:33 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:33 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.278s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:41:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.577s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Uploaded volume to glance image-id: 28230efa-8b54-4579-83cb-c250f51afd25. {{(pid=86933) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 32.519s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Creating offline snapshot 3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 of volume 63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:41:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3a9d39f0-e2f1-4a2e-a9f6-e53cb5aae6e4 tempest-TestImageHashVerification-1398509943 None] Copy volume to image completed successfully. Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d6899b-5660-4a6c-a7df-d509f93dce88]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:37 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 Sep 03 13:41:37 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:38 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107" returned: 0 in 0.351s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:38 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 1G Sep 03 13:41:38 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:38 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 1G" returned: 0 in 0.413s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:38 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 Sep 03 13:41:38 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:38 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" returned: 0 in 0.287s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:38 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 is being set with open permissions: ugo+rw Sep 03 13:41:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:38 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 Sep 03 13:41:38 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Acquiring lock "cinder-96a24a88-a936-4370-bd7f-479f4773efe4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "cinder-96a24a88-a936-4370-bd7f-479f4773efe4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:39 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info Sep 03 13:41:39 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Acquiring lock "cinder-quobyte-96a24a88-a936-4370-bd7f-479f4773efe4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "cinder-quobyte-96a24a88-a936-4370-bd7f-479f4773efe4" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a15c80b-f14c-4ef1-b837-c378f39dba65]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:39 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info" returned: 0 in 0.286s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:39 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info is being set with open permissions: ugo+rw Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info Sep 03 13:41:39 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4 Sep 03 13:41:39 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.info" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 22.960s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a7eaa-4905-4c0b-982a-456bd692acfd]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-63761f98-d3f0-47b3-8ada-b5e34d8970e8 req-84d59c1c-7613-4b22-b1b3-fcc251b21e6e tempest-VolumesSnapshotsTestJSON-2004857900 None] Create snapshot completed successfully Sep 03 13:41:39 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:41:39 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:39 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-96a24a88-a936-4370-bd7f-479f4773efe4" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "cinder-quobyte-96a24a88-a936-4370-bd7f-479f4773efe4" released by "delete_volume" :: held 0.716s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Created reservations ['beff79ef-d7c3-4487-bd49-debfdcf19564', '4feefd10-83d0-4095-8dce-f7d61e0a3fba', '710a9e96-35dc-43b2-9523-363927c06600', 'be82df53-9b88-4158-a715-34a72519e098'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:39 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:41:39 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:40 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.392s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff8c2e-c431-4136-93a9-16074c4ebb8d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:40 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:41:40 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:40 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.274s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:41:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Deleted volume successfully. Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d0a59455-d26e-45fc-bbda-f1825097df96 tempest-TestImageHashVerification-1398509943 None] Lock "cinder-96a24a88-a936-4370-bd7f-479f4773efe4-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:40 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.393s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b8qzecphv.img {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:40 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b8qzecphv.img Sep 03 13:41:40 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "cinder-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "cinder-quobyte-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Deleting offline snapshot 3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 of volume 63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] snapshot_file for this snap is: volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[891ac7a9-2c46-4ac8-ac61-2319f09b8e41]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:40 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 Sep 03 13:41:40 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:41 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" returned: 0 in 0.599s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:41:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[810aa936-ebac-46c8-b2d7-337e5f09126f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:41 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 Sep 03 13:41:41 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:42 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107" returned: 0 in 0.810s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:42 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 Sep 03 13:41:42 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:43 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" returned: 0 in 0.808s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:43 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5 Sep 03 13:41:43 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:43 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107.3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" returned: 0 in 0.601s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5" released by "_delete_snapshot" :: held 3.111s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" released by "delete_snapshot" :: held 3.146s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:43 devstack cinder-volume[86933]: DEBUG cinder.quota [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Created reservations ['3e99417f-4259-4131-96b0-37c56e9b180e', 'a9fe5b45-cd54-4765-abce-e041c5c6e57d', '46bf7c6b-a712-4af3-9232-19a7bcdd685a', 'e95792cd-e5da-4ff5-800f-10fb3f186feb'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Delete snapshot completed successfully. Sep 03 13:41:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-3051ca2c-2fc7-4b5c-b654-5dee65ee435a req-a4deab37-0424-437d-af0b-2da402cc4cb2 tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-3f4ac9ad-0ef0-4f93-b7d1-36b84c0f8fe5-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "cinder-63d5f7fc-23fe-4534-ae38-aeb6366c4107-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-63d5f7fc-23fe-4534-ae38-aeb6366c4107-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c3a144-90d1-4c25-960a-6723601f3837]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:45 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b8qzecphv.img" returned: 0 in 5.214s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1f464-97d2-45ca-915a-2108f00bea47]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:41:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:45 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 Sep 03 13:41:45 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:45 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:41:45 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:46 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:46 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107 Sep 03 13:41:46 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:46 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:46 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-63d5f7fc-23fe-4534-ae38-aeb6366c4107" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.598s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b8qzecphv.img {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:41:46 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Converted 1024.00 MB image at 196.31 MB/s Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-quobyte-63d5f7fc-23fe-4534-ae38-aeb6366c4107" released by "delete_volume" :: held 0.672s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] 11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b was raw, no need to convert to raw {{(pid=86933) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.quota [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Created reservations ['99558182-364f-4d39-8750-3a949fd104d8', '87072e38-1139-450e-9c5e-1b0664271c8b', '2e445354-7cba-4f74-8e70-97c9fc3b7365', 'e3e453cc-b0c9-4ed4-820c-2ddba2147908'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:41:46 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:41:46 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:41:46 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.318s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.manager [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:41:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Deleted volume successfully. Sep 03 13:41:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [req-32d3d17b-ad17-4099-bbad-b9b605d91a9a req-27473f66-139f-4f7f-94c0-f87432c18efb tempest-VolumesSnapshotsTestJSON-2004857900 None] Lock "cinder-63d5f7fc-23fe-4534-ae38-aeb6366c4107-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (580f705f-76b3-48cb-8a6b-982457afb162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e312d863-7f0c-45a9-b143-3421836de4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e312d863-7f0c-45a9-b143-3421836de4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-164645957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de528b87-285b-4e1e-b879-b11a701cf12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:57Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ed826a-d93f-4029-922a-e05311de8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ed826a-d93f-4029-922a-e05311de8042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffeb8186-3afe-450c-89f8-a395538e409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffeb8186-3afe-450c-89f8-a395538e409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de528b87-285b-4e1e-b879-b11a701cf12f', 'volume_name': 'volume-de528b87-285b-4e1e-b879-b11a701cf12f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2a55bb-ba03-4f44-a429-9baa6203016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2a55bb-ba03-4f44-a429-9baa6203016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e2770-f909-49c3-ad4b-0ee8b29f5e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Volume de528b87-285b-4e1e-b879-b11a701cf12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de528b87-285b-4e1e-b879-b11a701cf12f', 'volume_size': 1} Sep 03 13:41:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (7216b848-1ef8-43a9-bac6-3eb39020437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1807fee6-1a7d-42d8-8246-3b60acb9fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1807fee6-1a7d-42d8-8246-3b60acb9fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904317243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ceda97d-2d1d-4130-98bf-b2e3e67cd764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:57Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb7bc79-d076-485f-9509-e2aa915d4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb7bc79-d076-485f-9509-e2aa915d4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b50fe6-3d10-46c5-a68c-077c7dfa00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b50fe6-3d10-46c5-a68c-077c7dfa00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ceda97d-2d1d-4130-98bf-b2e3e67cd764', 'volume_name': 'volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e63303-544f-4dca-9721-9553eb5a3a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e63303-544f-4dca-9721-9553eb5a3a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de949033-ef84-4dd4-b2e9-69740e957dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Volume 2ceda97d-2d1d-4130-98bf-b2e3e67cd764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764', 'volume_size': 1} Sep 03 13:41:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d18b0fe8-0f75-4e4d-bffa-318e75e1f887 tempest-GroupsV314Test-1540152127 None] Group tempest-GroupsV314Test-Group-1354744074: creating Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (407c62a3-9213-4d2a-affc-79fcc4c7af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad4f71-87d7-44aa-ad43-637fc1197f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d18b0fe8-0f75-4e4d-bffa-318e75e1f887 tempest-GroupsV314Test-1540152127 None] Group tempest-GroupsV314Test-Group-1354744074: created successfully Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad4f71-87d7-44aa-ad43-637fc1197f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335483764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f40a7a-b6a9-4970-b53b-2acaea1b7c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:58Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb59a4b4-448c-4774-a086-b0844055478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb59a4b4-448c-4774-a086-b0844055478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227a0aa2-582b-4cb0-811f-b012fb10a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227a0aa2-582b-4cb0-811f-b012fb10a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f40a7a-b6a9-4970-b53b-2acaea1b7c28', 'volume_name': 'volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59379cc3-f8b2-40b6-bf84-467cd1cc0925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59379cc3-f8b2-40b6-bf84-467cd1cc0925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7533e273-3e84-47a6-9deb-751793034c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Volume e3f40a7a-b6a9-4970-b53b-2acaea1b7c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28', 'volume_size': 1} Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d18b0fe8-0f75-4e4d-bffa-318e75e1f887 tempest-GroupsV314Test-1540152127 None] Create group completed successfully. Sep 03 13:41:58 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (b049464a-d4c7-462d-89d5-f74b069d8fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b853dca5-052d-4887-a058-011148c47dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b853dca5-052d-4887-a058-011148c47dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-450055500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fee29ea-df84-4f65-98a6-1802087e7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:58Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf02173-3fc3-48fa-a686-8cece7d27770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf02173-3fc3-48fa-a686-8cece7d27770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f397738b-9b7c-4b43-b49d-a4eadffb8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f397738b-9b7c-4b43-b49d-a4eadffb8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fee29ea-df84-4f65-98a6-1802087e7b30', 'volume_name': 'volume-3fee29ea-df84-4f65-98a6-1802087e7b30', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f39597-230e-4336-8063-7f8df7ab16fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f39597-230e-4336-8063-7f8df7ab16fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12677b8-254c-47c0-8b29-584595afb662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Volume 3fee29ea-df84-4f65-98a6-1802087e7b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fee29ea-df84-4f65-98a6-1802087e7b30', 'volume_size': 1} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (8b17732d-f87d-43a0-803c-d198323d7511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d83cfcd-ae81-47c8-a13c-f0e99d737a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d83cfcd-ae81-47c8-a13c-f0e99d737a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908800187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:59Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee71db9-07c7-4c35-bb44-f74195bce168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee71db9-07c7-4c35-bb44-f74195bce168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e3c15a-21bd-4da6-a3fa-9d2753c1e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e3c15a-21bd-4da6-a3fa-9d2753c1e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7', 'volume_name': 'volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17dc92a-22fe-42fc-8a69-5056d4fcce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17dc92a-22fe-42fc-8a69-5056d4fcce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a867b-9555-4294-83d2-2e19ce05079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Volume a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7', 'volume_size': 1} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Flow 'volume_create_manager' (5c05b0f3-ac55-4b5c-934e-73a96fe62b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cba361e-50b3-457c-a70d-60b775104d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cba361e-50b3-457c-a70d-60b775104d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061259908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9442731-0bf3-4464-a16f-1d63fc5f5722,host='devstack@QuobyteHD#QuobyteHD',id=b98e8b90-8fd2-4bee-82da-acfe26d2e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba98eac84a67481f8f47aa1700894ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:00Z,use_quota=True,user_id='7bc859108e6b4081a6ae341b0c2cadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe97f2b-fd5b-460f-8c09-d5b48030f521),volume_type_id=cfe97f2b-fd5b-460f-8c09-d5b48030f521)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32628ed-02fa-4603-89e2-0d5fe3443518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32628ed-02fa-4603-89e2-0d5fe3443518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185c7c9a-2a55-4415-960d-558c6b23ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185c7c9a-2a55-4415-960d-558c6b23ba63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98e8b90-8fd2-4bee-82da-acfe26d2e72d', 'volume_name': 'volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f51c1d-977d-49ad-8216-e4329408943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f51c1d-977d-49ad-8216-e4329408943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94f9d07-118a-4546-bcec-44640e03e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:41:59 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Volume b98e8b90-8fd2-4bee-82da-acfe26d2e72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d', 'volume_size': 1} Sep 03 13:41:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.937s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Uploaded volume to glance image-id: 11a5fe1c-ffc1-4153-8ec1-d28273b7ec5b. {{(pid=86933) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 48.281s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1743637040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbe4e66-db6a-4a61-8172-f491cc654533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:20Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Creating volume 5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:08 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:08 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 1073741824 Sep 03 13:42:08 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3c8c86b3-77cd-4073-893b-54a8dbb7bbd3 tempest-VolumesActionsTest-1455620956 None] Copy volume to image completed successfully. Sep 03 13:42:09 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 1073741824" returned: 0 in 0.516s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:09 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:09 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:09 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.445s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-164645957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de528b87-285b-4e1e-b879-b11a701cf12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:57Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Creating volume de528b87-285b-4e1e-b879-b11a701cf12f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:09 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9f4cc1-29f6-48e8-b8c8-0d3ce76c4b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbe4e66-db6a-4a61-8172-f491cc654533', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:09 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f 1073741824 Sep 03 13:42:09 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c950540-f67d-4c48-91a1-2788d73d1d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Volume volume-5cbe4e66-db6a-4a61-8172-f491cc654533 (5cbe4e66-db6a-4a61-8172-f491cc654533): created successfully Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c950540-f67d-4c48-91a1-2788d73d1d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (1e64d95c-db8c-4f98-a493-43891c5c4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-877ad75d-f3bb-4422-9130-44898e099771 tempest-VolumesSnapshotTestJSON-33111012 None] Created volume successfully. Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:09 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f 1073741824" returned: 0 in 0.482s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:09 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f Sep 03 13:42:09 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:10 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f" returned: 0 in 0.245s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.871s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904317243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ceda97d-2d1d-4130-98bf-b2e3e67cd764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:57Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Creating volume 2ceda97d-2d1d-4130-98bf-b2e3e67cd764 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e2770-f909-49c3-ad4b-0ee8b29f5e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de528b87-285b-4e1e-b879-b11a701cf12f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:10 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 1073741824 Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1dc651-225a-4105-b4b8-082459d109ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:10 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Volume volume-de528b87-285b-4e1e-b879-b11a701cf12f (de528b87-285b-4e1e-b879-b11a701cf12f): created successfully Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1dc651-225a-4105-b4b8-082459d109ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (580f705f-76b3-48cb-8a6b-982457afb162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-bda77d2e-04db-40fe-a747-bf6f6a1eccef tempest-CreateVolumesFromImageTest-836035022 None] Created volume successfully. Sep 03 13:42:10 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 1073741824" returned: 0 in 0.429s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:10 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 Sep 03 13:42:10 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:10 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.647s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335483764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f40a7a-b6a9-4970-b53b-2acaea1b7c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:58Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Creating volume e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de949033-ef84-4dd4-b2e9-69740e957dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f3f043-d6b5-4127-a44b-989eb1232050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:10 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 1073741824 Sep 03 13:42:10 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Volume volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 (2ceda97d-2d1d-4130-98bf-b2e3e67cd764): created successfully Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f3f043-d6b5-4127-a44b-989eb1232050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (7216b848-1ef8-43a9-bac6-3eb39020437d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f0f918ed-ea73-4099-972e-80f55cfd9852 tempest-CreateVolumesFromImageTest-836035022 None] Created volume successfully. Sep 03 13:42:11 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 1073741824" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:11 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 Sep 03 13:42:11 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:11 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.525s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-450055500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fee29ea-df84-4f65-98a6-1802087e7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:58Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Creating volume 3fee29ea-df84-4f65-98a6-1802087e7b30 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:11 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7533e273-3e84-47a6-9deb-751793034c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:11 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 1073741824 Sep 03 13:42:11 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c22cb6-25cd-4f68-bc95-b7c344427368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:11 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Volume volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 (e3f40a7a-b6a9-4970-b53b-2acaea1b7c28): created successfully Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c22cb6-25cd-4f68-bc95-b7c344427368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (407c62a3-9213-4d2a-affc-79fcc4c7af48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ed50b2b7-1443-47ae-8e30-bc5b996160bc tempest-CreateVolumesFromImageTest-836035022 None] Created volume successfully. Sep 03 13:42:12 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 1073741824" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:12 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 Sep 03 13:42:12 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:12 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.835s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908800187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06b276a230b415ebb1b5060ff242458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:41:59Z,use_quota=True,user_id='7f1c360f45a94837a8b0b436b0b5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Creating volume a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:12 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12677b8-254c-47c0-8b29-584595afb662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fee29ea-df84-4f65-98a6-1802087e7b30', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:12 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 1073741824 Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6b5147-d67a-47b3-bb0b-d0de8445802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:12 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Volume volume-3fee29ea-df84-4f65-98a6-1802087e7b30 (3fee29ea-df84-4f65-98a6-1802087e7b30): created successfully Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6b5147-d67a-47b3-bb0b-d0de8445802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (b049464a-d4c7-462d-89d5-f74b069d8fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-71515486-6050-4885-ab39-6964433c1d21 tempest-CreateVolumesFromImageTest-836035022 None] Created volume successfully. Sep 03 13:42:12 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 1073741824" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:13 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 Sep 03 13:42:13 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:13 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.847s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9442731-0bf3-4464-a16f-1d63fc5f5722,created_at=2026-09-03T11:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061259908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9442731-0bf3-4464-a16f-1d63fc5f5722,host='devstack@QuobyteHD#QuobyteHD',id=b98e8b90-8fd2-4bee-82da-acfe26d2e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba98eac84a67481f8f47aa1700894ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:00Z,use_quota=True,user_id='7bc859108e6b4081a6ae341b0c2cadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe97f2b-fd5b-460f-8c09-d5b48030f521),volume_type_id=cfe97f2b-fd5b-460f-8c09-d5b48030f521)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Creating volume b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:13 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a867b-9555-4294-83d2-2e19ce05079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:13 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d 1073741824 Sep 03 13:42:13 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e739783-5fc5-4326-82dd-7cf7ce3ab0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:13 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Volume volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 (a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7): created successfully Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e739783-5fc5-4326-82dd-7cf7ce3ab0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Flow 'volume_create_manager' (8b17732d-f87d-43a0-803c-d198323d7511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cce9dd99-5e7b-4858-b5cd-0db0e6c76bb4 tempest-CreateVolumesFromImageTest-836035022 None] Created volume successfully. Sep 03 13:42:14 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d 1073741824" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:14 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:14 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:14 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.536s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94f9d07-118a-4546-bcec-44640e03e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a40080-debc-449a-92c1-e863fb2ff937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[425db6ce-22d6-41f9-8169-177b4d5d8652]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Volume volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d (b98e8b90-8fd2-4bee-82da-acfe26d2e72d): created successfully Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a40080-debc-449a-92c1-e863fb2ff937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Flow 'volume_create_manager' (5c05b0f3-ac55-4b5c-934e-73a96fe62b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-626bace4-246b-4cc1-8020-f7222436d462 tempest-GroupsV314Test-1540152127 None] Created volume successfully. Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-quobyte-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:14 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:42:14 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bd1fb3-c423-49ca-9dd7-9fca5a8ef124]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:14 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 Sep 03 13:42:14 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:14 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.426s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[734689a7-40c5-4e9c-a209-942e77c1457e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:14 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" returned: 0 in 0.412s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:15 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:42:15 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:15 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7 Sep 03 13:42:15 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:15 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7" released by "delete_volume" :: held 0.743s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:15 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:15 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img Sep 03 13:42:15 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Created reservations ['680fbe01-0f6a-4c26-9339-1a85fb7cfe4f', 'd3f73cfa-da34-4e7a-93b5-2b75418a8b93', 'a6749d1f-4480-44c1-a033-8bc0a10924e0', 'f79676ca-03bf-4672-bd66-264ff7f78990'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:15 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:15 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-3fee29ea-df84-4f65-98a6-1802087e7b30-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-3fee29ea-df84-4f65-98a6-1802087e7b30-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-quobyte-3fee29ea-df84-4f65-98a6-1802087e7b30" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-3fee29ea-df84-4f65-98a6-1802087e7b30" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0e7b1-5fe4-4f7a-b29e-dfa18d536373]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:15 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.468s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:15 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Deleted volume successfully. Sep 03 13:42:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d38c2a1b-11a3-4dcf-99a5-83780177c802 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-a9af95d7-7fdc-485c-b9bb-e9fc0cb638b7-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:16 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 Sep 03 13:42:16 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:16 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30" returned: 0 in 0.602s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:16 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30 Sep 03 13:42:16 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:17 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3fee29ea-df84-4f65-98a6-1802087e7b30" returned: 0 in 0.527s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-3fee29ea-df84-4f65-98a6-1802087e7b30" released by "delete_volume" :: held 1.245s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Created reservations ['4deeb0b7-7e05-44c7-b9c2-99a9b188fca0', '7b11201e-bbc1-4f0b-8cba-66a419eaae0a', 'c3b58e5d-ab39-45a7-854a-a208d5b3e6ab', '01379904-0b2c-400f-b923-dc0046008f08'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:17 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:17 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:17 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Deleted volume successfully. Sep 03 13:42:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1dc49433-9ae0-4800-91a9-244b7d1721ff tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-3fee29ea-df84-4f65-98a6-1802087e7b30-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-quobyte-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" acquired by "delete_volume" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df05591-8a3b-4b91-8385-f28093b18e8e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:18 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 Sep 03 13:42:18 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:19 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" returned: 0 in 0.566s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:19 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28 Sep 03 13:42:19 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:19 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" returned: 0 in 0.524s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28" released by "delete_volume" :: held 1.195s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Created reservations ['2eb6029c-f716-4955-b30c-1637d30f8070', '7cb4259c-0266-4bdf-a153-96d5a1901ed5', 'f7db83cd-e675-4cb2-ae58-fe39a05f0a6d', 'a2212e12-fe28-410a-b64d-c91dc87d4286'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:20 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:20 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:20 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img" returned: 0 in 4.983s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff2eaf-bef0-41d9-a97d-f0c5f14b5e77]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:20 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.438s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:20 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Deleted volume successfully. Sep 03 13:42:20 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:42:20 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-565454d7-6591-4489-9fe0-5da3b87c59af tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-e3f40a7a-b6a9-4970-b53b-2acaea1b7c28-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-2ceda97d-2d1d-4130-98bf-b2e3e67cd764-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-2ceda97d-2d1d-4130-98bf-b2e3e67cd764-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-quobyte-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd8f0f-9868-4474-a383-59f6b9ab0d86]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:20 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 Sep 03 13:42:20 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:20 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.548s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:42:20 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Converted 1024.00 MB image at 205.46 MB/s Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] 052c1df3-a1e5-4eda-a07e-aa8fadecab38 was raw, converting to qcow2 {{(pid=86933) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a77d68-d2c2-40ca-b113-cd0419a6eaa9]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:20 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img Sep 03 13:42:20 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:21 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764 Sep 03 13:42:21 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:21 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img Sep 03 13:42:21 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:21 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-2ceda97d-2d1d-4130-98bf-b2e3e67cd764" released by "delete_volume" :: held 0.657s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Created reservations ['cc122058-8927-4be5-a9b4-d0ad8e541e1a', '105b3a48-f377-4517-8c3e-9bd54be00ca7', '4e1844b3-25d5-4ab1-ab63-726fddc7a683', '7bb446ca-9c72-4ddc-a928-61098bbd3506'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:21 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:21 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img" returned: 1 in 0.330s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img /opt/stack/data/cinder/conversion/vol_upload_kgr9bber {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img /opt/stack/data/cinder/conversion/vol_upload_kgr9bber Sep 03 13:42:21 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:21 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.255s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Deleted volume successfully. Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eaa111d7-dc6b-4dcc-9a59-3e5231246966 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-2ceda97d-2d1d-4130-98bf-b2e3e67cd764-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-de528b87-285b-4e1e-b879-b11a701cf12f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:21 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img /opt/stack/data/cinder/conversion/vol_upload_kgr9bber" returned: 0 in 0.274s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Image conversion details: src /opt/stack/data/cinder/conversion/f057e898-60ca-424a-85f4-e2d063de8f3f.temp_image.052c1df3-a1e5-4eda-a07e-aa8fadecab38opz_m64h.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kgr9bber {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:42:21 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-de528b87-285b-4e1e-b879-b11a701cf12f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ede056-cedd-4530-b44f-048e395e43b0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgr9bber {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "cinder-quobyte-de528b87-285b-4e1e-b879-b11a701cf12f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-de528b87-285b-4e1e-b879-b11a701cf12f" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d6a25-93a3-41ca-b137-eb8df77c4798]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:21 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgr9bber Sep 03 13:42:21 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:22 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f Sep 03 13:42:22 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:22 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgr9bber" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:22 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:22 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f Sep 03 13:42:22 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:22 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-de528b87-285b-4e1e-b879-b11a701cf12f" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-quobyte-de528b87-285b-4e1e-b879-b11a701cf12f" released by "delete_volume" :: held 0.668s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Created reservations ['70afc2d6-1f68-447d-9600-66e59203d077', 'b024570f-772b-48e9-9596-0097d13c2b2b', '9ae88efb-5689-438d-ac0a-a1acd9d301f9', 'cf473749-d2db-4064-b187-cacbb42a3d96'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:22 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:22 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:22 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Deleted volume successfully. Sep 03 13:42:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0e0023e5-ba40-458d-ba79-8b7d0d17a0b0 tempest-CreateVolumesFromImageTest-836035022 None] Lock "cinder-de528b87-285b-4e1e-b879-b11a701cf12f-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.192s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Uploaded volume to glance image-id: 052c1df3-a1e5-4eda-a07e-aa8fadecab38. {{(pid=86933) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.832s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Creating offline snapshot 054c9c5d-da11-4102-8ef9-9d5ca2edba49 of volume 5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2cf50d26-50c0-4c52-9c17-e0b2b759ecec tempest-VolumesActionsTest-1455620956 None] Copy volume to image completed successfully. Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fab533-e0d1-4cc4-99a1-3ae1173f465a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:23 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:23 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:24 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:24 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 1G Sep 03 13:42:24 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:24 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 1G" returned: 0 in 0.465s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cbe4e66-db6a-4a61-8172-f491cc654533 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:24 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cbe4e66-db6a-4a61-8172-f491cc654533 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:24 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:24 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cbe4e66-db6a-4a61-8172-f491cc654533 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.348s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:24 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 is being set with open permissions: ugo+rw Sep 03 13:42:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:24 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:24 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:25 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:25 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info Sep 03 13:42:25 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "cinder-quobyte-f057e898-60ca-424a-85f4-e2d063de8f3f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-quobyte-f057e898-60ca-424a-85f4-e2d063de8f3f" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f4ebdc-a1ca-4528-b26d-2153fd0e7079]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:25 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info" returned: 0 in 0.313s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:25 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info is being set with open permissions: ugo+rw Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:25 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:42:25 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:25 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info Sep 03 13:42:25 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:25 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:25 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.385s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.info" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:25 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f Sep 03 13:42:25 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.390s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:25 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Cloning volume b98e8b90-8fd2-4bee-82da-acfe26d2e72d to volume 2561275d-781f-4ded-803d-2281cc291d08 Sep 03 13:42:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e96d9a34-d10a-4d1e-8dac-3c1edd501f69 tempest-VolumesSnapshotTestJSON-33111012 None] Create snapshot completed successfully Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Creating offline snapshot fc6c935a-fe91-452e-814f-ed8f566ba491 of volume b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f7340-be45-474f-b6d2-bab878f41b3d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:26 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:26 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:26 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f057e898-60ca-424a-85f4-e2d063de8f3f" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-quobyte-f057e898-60ca-424a-85f4-e2d063de8f3f" released by "delete_volume" :: held 0.740s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Flow 'volume_create_manager' (f8573233-7f35-4771-a54b-f9a05f933ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341415cb-f834-43eb-8736-9b00277d8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Created reservations ['71113aaf-b8c0-4163-b585-df989b3da996', '70c859a8-893d-4925-8d0d-c18236f9736c', '3f8652a9-cf99-4fed-ad1c-70eb3e4570b6', '8c34c25e-4049-4c58-8128-573e28df6232'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341415cb-f834-43eb-8736-9b00277d8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3e860a-b2a2-4536-aef8-45f720028e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbb49a89840403d9f804be7de9c1b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:26Z,use_quota=True,user_id='4516014cee1c43adb6c08f436312eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57de73c6-a940-4e0d-b53e-ce4caf35fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57de73c6-a940-4e0d-b53e-ce4caf35fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b53c96-9b7a-4f95-b8b5-35211589ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b53c96-9b7a-4f95-b8b5-35211589ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3e860a-b2a2-4536-aef8-45f720028e3c', 'volume_name': 'volume-1b3e860a-b2a2-4536-aef8-45f720028e3c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83a0d08-f901-4992-b65b-0525397a5d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83a0d08-f901-4992-b65b-0525397a5d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee87d0-e5c0-4631-bea4-3b15f7621786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Volume 1b3e860a-b2a2-4536-aef8-45f720028e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3e860a-b2a2-4536-aef8-45f720028e3c', 'volume_size': 1} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:26 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.436s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:26 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:26 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:26 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 1G Sep 03 13:42:26 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:26 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Deleted volume successfully. Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7686c3b-4733-4400-89cf-1323f2253a48 tempest-VolumesActionsTest-1455620956 None] Lock "cinder-f057e898-60ca-424a-85f4-e2d063de8f3f-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:26 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 1G" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:26 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:26 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:27 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.481s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:27 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:27 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (eebbcf36-82fc-4efd-86d1-1f546e8eafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e840a8-5134-4f15-a853-487a724530bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e840a8-5134-4f15-a853-487a724530bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1342619168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d9df03-78a5-4a4a-a1a3-f4db2565c3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd16fc4974544148b8c36ac695223f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=054c9c5d-da11-4102-8ef9-9d5ca2edba49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:27Z,use_quota=True,user_id='f8c201e15c3447989faa226650181640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96470cc6-4f77-4bf0-b3b6-c31bf6d37c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96470cc6-4f77-4bf0-b3b6-c31bf6d37c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b876c2-d8f7-4542-a1ef-92f2abe0d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b876c2-d8f7-4542-a1ef-92f2abe0d792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39d9df03-78a5-4a4a-a1a3-f4db2565c3db', 'volume_name': 'volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db', 'volume_size': 1, 'snapshot_id': '054c9c5d-da11-4102-8ef9-9d5ca2edba49'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6deb322-2913-4f59-9b97-8520521520e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6deb322-2913-4f59-9b97-8520521520e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b892817-229c-40e2-b835-aa57c3e9b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:27 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Volume 39d9df03-78a5-4a4a-a1a3-f4db2565c3db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db', 'volume_size': 1, 'snapshot_id': '054c9c5d-da11-4102-8ef9-9d5ca2edba49'} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:27 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:27 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info Sep 03 13:42:27 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:27 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:42:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:27 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info Sep 03 13:42:27 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:28 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.info" returned: 0 in 0.272s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Acquiring lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] snapshot: fc6c935a-fe91-452e-814f-ed8f566ba491, volume: 2561275d-781f-4ded-803d-2281cc291d08, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce327d9d-f5e3-401a-82e6-d4888fdc2fc3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:28 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:28 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:28 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa0635-6b1a-47d9-9278-f52139aca658]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:28 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:28 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:29 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.392s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:42:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:42:29 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:42:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:29 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 Sep 03 13:42:29 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:33 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:33 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08" returned: 0 in 5.040s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:42:34 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Converted 1024.00 MB image at 203.12 MB/s Sep 03 13:42:34 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:34 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 Sep 03 13:42:34 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:34 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.483s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:42:34 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" released by "_copy_volume_from_snapshot" :: held 6.126s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=79,cinder:UPDATE=93,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Acquiring lock "cinder-quobyte-fc6c935a-fe91-452e-814f-ed8f566ba491" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-fc6c935a-fe91-452e-814f-ed8f566ba491" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Deleting offline snapshot fc6c935a-fe91-452e-814f-ed8f566ba491 of volume b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] snapshot_file for this snap is: volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[82944bfe-49ea-40f4-b3e8-6b6861ee52e0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:34 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:34 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:34 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b623dc-4fbd-4f32-af9f-9e89eff1784b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:34 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:34 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:35 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.565s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:35 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:35 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:35 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.366s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:35 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491 Sep 03 13:42:35 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Flow 'volume_create_manager' (d6717f09-da7b-42fd-b4a3-82addf94116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0bf27c-423c-474d-adc6-fdaadaaf9ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0bf27c-423c-474d-adc6-fdaadaaf9ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2081603751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bffeb3-4abc-4e43-99b9-7981605ca125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ca7fd3951246a1b845d14ffb106c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:36Z,use_quota=True,user_id='19bd5c78b13a443f96f081ea56992015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0092a34-0be7-4b42-831a-5931993e6b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0092a34-0be7-4b42-831a-5931993e6b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5302082b-84ec-46a4-b1ae-baba1682d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5302082b-84ec-46a4-b1ae-baba1682d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bffeb3-4abc-4e43-99b9-7981605ca125', 'volume_name': 'volume-89bffeb3-4abc-4e43-99b9-7981605ca125', 'volume_size': 2}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b89849e-b47d-49b4-9635-6196ef9efc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b89849e-b47d-49b4-9635-6196ef9efc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6eb2ffe-8851-455f-95ad-0861e547bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:35 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Volume 89bffeb3-4abc-4e43-99b9-7981605ca125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bffeb3-4abc-4e43-99b9-7981605ca125', 'volume_size': 2} Sep 03 13:42:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:36 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d.fc6c935a-fe91-452e-814f-ed8f566ba491" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-fc6c935a-fe91-452e-814f-ed8f566ba491" released by "_delete_snapshot" :: held 1.660s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.273s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.825s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3e860a-b2a2-4536-aef8-45f720028e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbb49a89840403d9f804be7de9c1b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:26Z,use_quota=True,user_id='4516014cee1c43adb6c08f436312eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Creating volume 1b3e860a-b2a2-4536-aef8-45f720028e3c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:36 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:36 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c 1073741824 Sep 03 13:42:36 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9686ed45-9097-46b1-8612-60f0706243b2 tempest-GroupsV314Test-1540152127 None] Create group from source-group-a9442731-0bf3-4464-a16f-1d63fc5f5722 completed successfully. Sep 03 13:42:36 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c 1073741824" returned: 0 in 0.401s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:36 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c Sep 03 13:42:36 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:36 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.311s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee87d0-e5c0-4631-bea4-3b15f7621786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3e860a-b2a2-4536-aef8-45f720028e3c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa30e8-b72e-4aed-80d6-292492a3765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Creating volume 39d9df03-78a5-4a4a-a1a3-f4db2565c3db from snapshot 054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:36 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Volume volume-1b3e860a-b2a2-4536-aef8-45f720028e3c (1b3e860a-b2a2-4536-aef8-45f720028e3c): created successfully Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa30e8-b72e-4aed-80d6-292492a3765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Flow 'volume_create_manager' (f8573233-7f35-4771-a54b-f9a05f933ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] snapshot: 054c9c5d-da11-4102-8ef9-9d5ca2edba49, volume: 39d9df03-78a5-4a4a-a1a3-f4db2565c3db, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:42:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8e3eb969-1194-42b7-8bfa-9f83c9a3d18b tempest-CinderUnicodeTest-347915573 None] Created volume successfully. Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789722b-d190-461f-b8d4-7750bb4295c1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:36 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:36 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:37 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.360s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cbe4e66-db6a-4a61-8172-f491cc654533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd752cbd-9bea-41dd-b118-27b955a2be5f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:37 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:37 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:37 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.398s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:37 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db Sep 03 13:42:37 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Acquiring lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c63224-5cfe-435a-a33f-47a0dff7fff0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Flow 'volume_create_manager' (7c2eb20e-83b3-4c31-a60b-a2ff881714a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682cc4ed-712a-47eb-a1aa-01f1a868f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:38 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 Sep 03 13:42:38 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682cc4ed-712a-47eb-a1aa-01f1a868f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1961861677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a8bac6-860f-4476-88c5-7348a46286b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbb49a89840403d9f804be7de9c1b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:38Z,use_quota=True,user_id='4516014cee1c43adb6c08f436312eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9374d82-cb24-47d7-9e9f-3b502b033577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9374d82-cb24-47d7-9e9f-3b502b033577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a72f1d1-3bd3-44b1-8629-7f28bdbcc8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a72f1d1-3bd3-44b1-8629-7f28bdbcc8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a8bac6-860f-4476-88c5-7348a46286b3', 'volume_name': 'volume-76a8bac6-860f-4476-88c5-7348a46286b3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd973c4-bdce-4ee8-b5de-9a43143b83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd973c4-bdce-4ee8-b5de-9a43143b83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a671d7-366d-4114-9851-7d3871cb8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:38 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Volume 76a8bac6-860f-4476-88c5-7348a46286b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a8bac6-860f-4476-88c5-7348a46286b3', 'volume_size': 1} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:38 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08" returned: 0 in 0.481s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:38 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08 Sep 03 13:42:38 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:39 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2561275d-781f-4ded-803d-2281cc291d08" returned: 0 in 0.701s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-2561275d-781f-4ded-803d-2281cc291d08" released by "delete_volume" :: held 1.270s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Created reservations ['64b92f63-b15d-4394-969f-1f728d99dd03'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:39 devstack cinder-volume[86933]: WARNING cinder.quota [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-928676584 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-928676584, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:42:39 devstack cinder-volume[86933]: WARNING cinder.quota [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-928676584 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-928676584, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Created reservations ['799d0a70-3974-485d-9297-8b78d7d221dd', 'a7952e2c-816f-4633-81d1-a4590a63ddc2', 'ee502ffc-20ea-43c2-9893-8a9b211b35cb', '56ec361c-6f40-4536-ae66-b6f64b747665'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:39 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:39 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:40 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.543s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:40 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-dbe9ff1c-32fa-43eb-8eb5-bba3c6f65ec5 tempest-GroupsV314Test-1540152127 None] Delete group completed successfully. Sep 03 13:42:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Acquiring lock "cinder-quobyte-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" acquired by "delete_volume" :: waited 0.043s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5bb9a-5120-49ce-bb22-d40bbcb51a30]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:41 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:41 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:42 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.835s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:42 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d Sep 03 13:42:42 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:42 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" returned: 0 in 4.912s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:42:42 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Converted 1024.00 MB image at 208.38 MB/s Sep 03 13:42:42 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db is being set with open permissions: ugo+rw Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:42 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" returned: 0 in 0.466s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:42 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db Sep 03 13:42:42 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Lock "cinder-quobyte-b98e8b90-8fd2-4bee-82da-acfe26d2e72d" released by "delete_volume" :: held 1.465s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Created reservations ['c9cb6a23-7ed0-42a4-8c5e-2cde12498728'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Created reservations ['7e3b14a6-e937-4ea0-a188-5aea8b004d56', '013dcdce-9d3e-48d7-8753-8b57156265d7', 'e7af1467-522f-4bc8-81c9-42958a502632', '92d931f9-3353-4dec-896c-6bd7e52fa25f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:42 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" returned: 0 in 0.255s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" released by "_copy_volume_from_snapshot" :: held 6.024s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:42 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:42 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" released by "_create_volume_from_snapshot" :: held 6.093s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.124s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2081603751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bffeb3-4abc-4e43-99b9-7981605ca125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ca7fd3951246a1b845d14ffb106c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:36Z,use_quota=True,user_id='19bd5c78b13a443f96f081ea56992015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Creating volume 89bffeb3-4abc-4e43-99b9-7981605ca125 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:42 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 2147483648 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:42 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 2147483648 Sep 03 13:42:42 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b892817-229c-40e2-b835-aa57c3e9b214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db', 'volume_size': 1, 'snapshot_id': '054c9c5d-da11-4102-8ef9-9d5ca2edba49'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e361d59-234c-4d36-8be7-2b7a5791306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:42 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Volume volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db (39d9df03-78a5-4a4a-a1a3-f4db2565c3db): created successfully Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e361d59-234c-4d36-8be7-2b7a5791306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:42 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Flow 'volume_create_manager' (eebbcf36-82fc-4efd-86d1-1f546e8eafa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1c878dcd-e466-4b21-afd4-e24eae416246 tempest-VolumesSnapshotTestJSON-33111012 None] Created volume successfully. Sep 03 13:42:43 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0ba7df1d-3c8d-4045-a85f-c377fa7abe5a tempest-GroupsV314Test-1540152127 None] Delete group completed successfully. Sep 03 13:42:43 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 2147483648" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:43 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 Sep 03 13:42:43 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:43 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.597s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1961861677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a8bac6-860f-4476-88c5-7348a46286b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbb49a89840403d9f804be7de9c1b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:38Z,use_quota=True,user_id='4516014cee1c43adb6c08f436312eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Creating volume 76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:43 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6eb2ffe-8851-455f-95ad-0861e547bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bffeb3-4abc-4e43-99b9-7981605ca125', 'volume_size': 2}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:43 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 1073741824 Sep 03 13:42:43 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e65d14-328a-4f22-b260-6193b1adb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:43 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Volume volume-89bffeb3-4abc-4e43-99b9-7981605ca125 (89bffeb3-4abc-4e43-99b9-7981605ca125): created successfully Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e65d14-328a-4f22-b260-6193b1adb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Flow 'volume_create_manager' (d6717f09-da7b-42fd-b4a3-82addf94116b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5334ca42-30d0-4177-a7e4-41102c2d1721 tempest-VolumesCloneNegativeTest-906185511 None] Created volume successfully. Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-39d9df03-78a5-4a4a-a1a3-f4db2565c3db-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-39d9df03-78a5-4a4a-a1a3-f4db2565c3db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1fc6dc-701f-49f8-852e-d1f64afb8f83]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:44 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 1073741824" returned: 0 in 0.510s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:44 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db Sep 03 13:42:44 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:44 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 Sep 03 13:42:44 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:44 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a671d7-366d-4114-9851-7d3871cb8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a8bac6-860f-4476-88c5-7348a46286b3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c038800-d6a3-4392-a773-495066236391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Volume volume-76a8bac6-860f-4476-88c5-7348a46286b3 (76a8bac6-860f-4476-88c5-7348a46286b3): created successfully Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c038800-d6a3-4392-a773-495066236391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:44 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Flow 'volume_create_manager' (7c2eb20e-83b3-4c31-a60b-a2ff881714a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a1a404e8-9479-4440-8cb8-e7159685a7c8 tempest-CinderUnicodeTest-347915573 None] Created volume successfully. Sep 03 13:42:44 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db Sep 03 13:42:44 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:44 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-39d9df03-78a5-4a4a-a1a3-f4db2565c3db" released by "delete_volume" :: held 0.777s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['abaa43ba-7ffd-4175-be41-3c5cfeeb018f', '4f8412d8-4a0d-46f7-9b29-1799e9b67a98', '07fb2845-5a52-4f64-931a-5567f115e9f3', 'a42ca6d1-13f7-4de0-b4c2-b3b7f31b23d2'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Acquiring lock "cinder-89bffeb3-4abc-4e43-99b9-7981605ca125-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "cinder-89bffeb3-4abc-4e43-99b9-7981605ca125-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Acquiring lock "cinder-quobyte-89bffeb3-4abc-4e43-99b9-7981605ca125" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:45 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:45 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "cinder-quobyte-89bffeb3-4abc-4e43-99b9-7981605ca125" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8887395-2f07-4ab0-af54-f26f96810737]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:45 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 Sep 03 13:42:45 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-054c9c5d-da11-4102-8ef9-9d5ca2edba49-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-054c9c5d-da11-4102-8ef9-9d5ca2edba49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Deleting offline snapshot 054c9c5d-da11-4102-8ef9-9d5ca2edba49 of volume 5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:42:45 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] snapshot_file for this snap is: volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d29c8a-a10e-481c-bc71-a289b493413a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Deleted volume successfully. Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-41108063-6b8b-4d28-9001-0e7b5dcd52e4 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-39d9df03-78a5-4a4a-a1a3-f4db2565c3db-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:45 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:45 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:45 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125" returned: 0 in 0.472s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:45 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125 Sep 03 13:42:45 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:45 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-89bffeb3-4abc-4e43-99b9-7981605ca125" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:45 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.480s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cbe4e66-db6a-4a61-8172-f491cc654533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "cinder-quobyte-89bffeb3-4abc-4e43-99b9-7981605ca125" released by "delete_volume" :: held 0.828s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e2cb7-00f8-479c-b863-f55f834317c6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:45 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Created reservations ['c4507903-10be-4524-9453-36c81f4a0408', 'fefed518-f9ab-4d0c-9dbc-781b9876bd69', '6bbbf443-0750-480a-a5e1-8f8664d6eb02', '721f41e7-9d18-4bf2-a777-7f3df7cd92aa'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Creating offline snapshot e5d06484-a021-4577-abb1-715104e02bb1 of volume 76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:46 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:46 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b7e1c-6e28-4c24-9227-6e349b3483a5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:46 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:46 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:46 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 Sep 03 13:42:46 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:46 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:46 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.470s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Deleted volume successfully. Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3" returned: 0 in 0.568s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:46 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 1G Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2af9ba38-254c-498d-81f8-ee1d4bfafd8e tempest-VolumesCloneNegativeTest-906185511 None] Lock "cinder-89bffeb3-4abc-4e43-99b9-7981605ca125-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:46 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:46 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.834s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:46 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:46 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:47 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 1G" returned: 0 in 0.521s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a8bac6-860f-4476-88c5-7348a46286b3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:47 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a8bac6-860f-4476-88c5-7348a46286b3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 Sep 03 13:42:47 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:47 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.487s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:47 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49 Sep 03 13:42:47 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:47 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a8bac6-860f-4476-88c5-7348a46286b3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1" returned: 0 in 0.365s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:47 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 is being set with open permissions: ugo+rw Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:47 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 Sep 03 13:42:47 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:47 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533.054c9c5d-da11-4102-8ef9-9d5ca2edba49" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-054c9c5d-da11-4102-8ef9-9d5ca2edba49" released by "_delete_snapshot" :: held 2.361s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" released by "delete_snapshot" :: held 2.389s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['a3399b1d-2abc-45db-962d-3f25e5779e1d', 'cfb0c9a8-1338-4756-a316-e2def92844b5', '8bc2f89c-5d96-4bb5-9c04-d90eb714b807', 'd30727bc-0fb5-46d5-bb35-e074fd1d1ee0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Delete snapshot completed successfully. Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-48079843-5eca-4598-a70d-26088748bc7a tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-054c9c5d-da11-4102-8ef9-9d5ca2edba49-delete_snapshot" released by "delete_snapshot" :: held 2.576s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:47 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:47 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info Sep 03 13:42:47 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:48 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:48 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info is being set with open permissions: ugo+rw Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:48 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info Sep 03 13:42:48 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:48 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.info" returned: 0 in 0.289s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cbb65930-dbf7-4bf0-8506-fb38b3108d75 tempest-CinderUnicodeTest-347915573 None] Create snapshot completed successfully Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-5cbe4e66-db6a-4a61-8172-f491cc654533-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-5cbe4e66-db6a-4a61-8172-f491cc654533-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2508c1e2-57fe-4f1c-bf6a-fe868c2ed9fd]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:48 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:48 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:49 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.382s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:49 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533 Sep 03 13:42:49 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:49 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5cbe4e66-db6a-4a61-8172-f491cc654533" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-5cbe4e66-db6a-4a61-8172-f491cc654533" released by "delete_volume" :: held 0.730s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['03c73964-f1aa-45a0-9bee-30bd743e0776', 'f90bd5d6-acec-4264-b493-958578644b12', '0d11c1c7-3617-4ef6-8877-667f23101b45', '5b92529b-4fac-4bc8-9395-e04129bbbe43'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:49 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:49 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-e5d06484-a021-4577-abb1-715104e02bb1-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-e5d06484-a021-4577-abb1-715104e02bb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-quobyte-e5d06484-a021-4577-abb1-715104e02bb1" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-e5d06484-a021-4577-abb1-715104e02bb1" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Deleting offline snapshot e5d06484-a021-4577-abb1-715104e02bb1 of volume 76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] snapshot_file for this snap is: volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:42:49 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.359s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b10726-524f-4545-af02-8debdaa01cb1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Deleted volume successfully. Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6406babb-d1b3-4528-9ebf-a543761786b3 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-5cbe4e66-db6a-4a61-8172-f491cc654533-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-9d0ed883-36e9-4220-91a1-5267e813ce3d-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-9d0ed883-36e9-4220-91a1-5267e813ce3d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:50 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:50 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedabac2-1573-421c-b519-ceebb04aad6a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Flow 'volume_create_manager' (4de65925-3a79-46eb-96f5-90b9977b5bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:50 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d Sep 03 13:42:50 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bca4038-854d-45ff-9b15-960ac278ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bca4038-854d-45ff-9b15-960ac278ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1808055633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e356d-3a31-4f22-a92a-3974b3da8dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7390f76693ce4358a32f015eeac9cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:50Z,use_quota=True,user_id='063c3d217bd24ebfae1b5eed61011445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b9b5dd-cb0a-41b7-b7ab-d7d0a5a57aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b9b5dd-cb0a-41b7-b7ab-d7d0a5a57aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe22406e-a69c-4788-b2fe-9329e9d4ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe22406e-a69c-4788-b2fe-9329e9d4ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437e356d-3a31-4f22-a92a-3974b3da8dc5', 'volume_name': 'volume-437e356d-3a31-4f22-a92a-3974b3da8dc5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df197a0-75e6-4cb2-9382-ded8825be270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df197a0-75e6-4cb2-9382-ded8825be270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5082f898-abba-4d8a-99f3-095f010e844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Volume 437e356d-3a31-4f22-a92a-3974b3da8dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437e356d-3a31-4f22-a92a-3974b3da8dc5', 'volume_size': 1} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1808055633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e356d-3a31-4f22-a92a-3974b3da8dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7390f76693ce4358a32f015eeac9cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:50Z,use_quota=True,user_id='063c3d217bd24ebfae1b5eed61011445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Creating volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:50 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:42:50 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 1073741824 Sep 03 13:42:50 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Flow 'volume_create_manager' (6335ffcb-3f0f-45d8-aaf1-f17696925d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f07df0-b6bc-46e0-ae18-efa343015bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1" returned: 0 in 0.472s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76a8bac6-860f-4476-88c5-7348a46286b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[609dcedd-e784-4c6c-9a07-f167e930a286]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f07df0-b6bc-46e0-ae18-efa343015bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1844902825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02366aee-0b32-4db0-a5eb-8a42379b89af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a148f219b02c431ba153fdeb655eae95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:50Z,use_quota=True,user_id='b70e8fbc098f4b0b8b5a2ba47dbd7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879483b-cbd3-4a92-8a87-1cb62223546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879483b-cbd3-4a92-8a87-1cb62223546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d0a8c3-cd1f-4720-b1ea-131d1899791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d0a8c3-cd1f-4720-b1ea-131d1899791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02366aee-0b32-4db0-a5eb-8a42379b89af', 'volume_name': 'volume-02366aee-0b32-4db0-a5eb-8a42379b89af', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96039237-6380-4940-8733-90c802b3fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96039237-6380-4940-8733-90c802b3fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5137c6a-992e-4449-a9c9-41c0726b2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Volume 02366aee-0b32-4db0-a5eb-8a42379b89af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02366aee-0b32-4db0-a5eb-8a42379b89af', 'volume_size': 1} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:50 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d" returned: 0 in 0.397s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d Sep 03 13:42:50 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 Sep 03 13:42:50 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 1073741824" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:50 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9d0ed883-36e9-4220-91a1-5267e813ce3d" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-quobyte-9d0ed883-36e9-4220-91a1-5267e813ce3d" released by "delete_volume" :: held 0.738s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3" returned: 0 in 0.447s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:50 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 Sep 03 13:42:50 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:50 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 Sep 03 13:42:50 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:50 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Created reservations ['37942aa2-6ab4-4503-88d7-b73416aae3bf', '52a7b2bf-2346-4553-92e0-f918c7b56bf1', '4a61f1f5-4566-4547-8d22-bfbb5fa16940', '04a4cce1-d816-4274-9675-527121317331'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:51 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:51 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:51 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1844902825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02366aee-0b32-4db0-a5eb-8a42379b89af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a148f219b02c431ba153fdeb655eae95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:42:50Z,use_quota=True,user_id='b70e8fbc098f4b0b8b5a2ba47dbd7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Creating volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:42:51 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5082f898-abba-4d8a-99f3-095f010e844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437e356d-3a31-4f22-a92a-3974b3da8dc5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb6a765-745f-4520-8758-df344e15a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:51 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af 1073741824 Sep 03 13:42:51 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Volume volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 (437e356d-3a31-4f22-a92a-3974b3da8dc5): created successfully Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb6a765-745f-4520-8758-df344e15a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Flow 'volume_create_manager' (4de65925-3a79-46eb-96f5-90b9977b5bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b9f516ca-5ed3-4af5-b7f5-1e53dc635dec tempest-VolumesSnapshotListTestJSON-110502385 None] Created volume successfully. Sep 03 13:42:51 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Deleted volume successfully. Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1b5769d4-6b0d-4e63-b574-e2bce4d27db5 tempest-VolumesSnapshotTestJSON-33111012 None] Lock "cinder-9d0ed883-36e9-4220-91a1-5267e813ce3d-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:51 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1" returned: 0 in 0.459s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:51 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1 Sep 03 13:42:51 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:51 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3.e5d06484-a021-4577-abb1-715104e02bb1" returned: 0 in 0.272s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:51 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af 1073741824" returned: 0 in 0.486s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-e5d06484-a021-4577-abb1-715104e02bb1" released by "_delete_snapshot" :: held 1.801s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" released by "delete_snapshot" :: held 1.856s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:51 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af Sep 03 13:42:51 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Created reservations ['3038af87-bbff-4bdd-87eb-366468b9c414', '953dcab9-28b2-49d3-ac49-c0cbe174b2c3', '96ec2335-222c-43b2-a0a3-08e5c4baafb8', 'e47a1920-fc34-47f7-95db-3d035facdc50'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Delete snapshot completed successfully. Sep 03 13:42:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dd64f136-857e-4bd6-921c-7308870b6473 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-e5d06484-a021-4577-abb1-715104e02bb1-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:52 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5137c6a-992e-4449-a9c9-41c0726b2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02366aee-0b32-4db0-a5eb-8a42379b89af', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb0854-2dab-4520-b876-79a4ad772aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-76a8bac6-860f-4476-88c5-7348a46286b3-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:52 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Volume volume-02366aee-0b32-4db0-a5eb-8a42379b89af (02366aee-0b32-4db0-a5eb-8a42379b89af): created successfully Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb0854-2dab-4520-b876-79a4ad772aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Flow 'volume_create_manager' (6335ffcb-3f0f-45d8-aaf1-f17696925d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-76a8bac6-860f-4476-88c5-7348a46286b3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e7ec8844-0261-42e0-97cb-447671207238 tempest-SnapshotsActionsTest-23946986 None] Created volume successfully. Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2549aa8c-63ca-4860-af5f-b7a7b726f8b4]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:52 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 Sep 03 13:42:52 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Creating offline snapshot 9bd9ee76-2748-48e0-bc70-5d51fd9fff4c of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ae081-3c34-4cb4-a1e8-a25b12646f10]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:52 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 Sep 03 13:42:52 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:52 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3" returned: 0 in 0.533s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:52 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3 Sep 03 13:42:52 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:52 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:53 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c 1G Sep 03 13:42:53 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:53 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-76a8bac6-860f-4476-88c5-7348a46286b3" returned: 0 in 0.301s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-76a8bac6-860f-4476-88c5-7348a46286b3" released by "delete_volume" :: held 0.928s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Created reservations ['9588cfb0-66f6-4b0e-aaad-446a33b299a6', '6e580456-86f0-4321-bfca-2b10c896ccbe', 'abd78853-7ff3-40ff-85c5-6d49a36fea7f', '0ee64a6b-7e3f-42a4-b311-697e9c9ed6c1'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:53 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:53 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-1b3e860a-b2a2-4536-aef8-45f720028e3c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-1b3e860a-b2a2-4536-aef8-45f720028e3c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "cinder-quobyte-1b3e860a-b2a2-4536-aef8-45f720028e3c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-1b3e860a-b2a2-4536-aef8-45f720028e3c" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab7619-7bee-4e62-8390-3e3e0720cca2]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:53 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c 1G" returned: 0 in 0.594s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:53 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.320s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Deleted volume successfully. Sep 03 13:42:53 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:42:53 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cafea9e6-cbdc-4c5f-b4d9-678025768893 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-76a8bac6-860f-4476-88c5-7348a46286b3-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:53 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c Sep 03 13:42:53 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:53 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.348s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:53 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c is being set with open permissions: ugo+rw Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:53 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:42:53 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:53 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c" returned: 0 in 0.439s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:54 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c Sep 03 13:42:54 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:54 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:54 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b3e860a-b2a2-4536-aef8-45f720028e3c" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-quobyte-1b3e860a-b2a2-4536-aef8-45f720028e3c" released by "delete_volume" :: held 0.741s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:54 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info Sep 03 13:42:54 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Created reservations ['875ca328-9b32-4aee-81f3-735b52edc828', '46eabc48-2676-4187-9e05-1e6b22fbe4ec', '24cbbb92-381b-43c7-9c8c-63bf1479d43e', '701fe7a7-8179-4e24-a363-45e8afae45dd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:54 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:42:54 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:54 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:54 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info is being set with open permissions: ugo+rw Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:54 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info Sep 03 13:42:54 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:54 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:42:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Deleted volume successfully. Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5034165b-2e83-406f-b3ca-5e780b94a366 tempest-CinderUnicodeTest-347915573 None] Lock "cinder-1b3e860a-b2a2-4536-aef8-45f720028e3c-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:42:54 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.info" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.197s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Creating offline snapshot eb84fec9-efd5-4fd4-87ea-a4c7d96e795c of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea47b21-69ee-48e0-b0a4-37177a30711f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-70801e2d-6ece-4cbd-ada5-73bd472c0c09 tempest-VolumesSnapshotListTestJSON-110502385 None] Create snapshot completed successfully Sep 03 13:42:55 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af Sep 03 13:42:55 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:55 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af" returned: 0 in 0.512s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:55 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c 1G Sep 03 13:42:55 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:55 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c 1G" returned: 0 in 0.574s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:56 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:42:56 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:56 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.374s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:56 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c is being set with open permissions: ugo+rw Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:56 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:42:56 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:56 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=178,cinder:SELECT=138,cinder:INSERT=49,cinder:DELETE=13 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:56 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info Sep 03 13:42:56 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:56 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:56 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info is being set with open permissions: ugo+rw Sep 03 13:42:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:56 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info Sep 03 13:42:56 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:57 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.info" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.223s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Creating offline snapshot c87c9e35-87c4-4d0c-8b94-233a21efadee of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b3fdc-f39b-49b7-b524-95cccbed7279]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5bf2ea9a-ca27-4314-a4a1-37ca06a9ea4f tempest-SnapshotsActionsTest-23946986 None] Create snapshot completed successfully Sep 03 13:42:57 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:42:57 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:57 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.366s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:57 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee 1G Sep 03 13:42:57 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:58 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee 1G" returned: 0 in 0.501s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:58 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:42:58 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:58 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.440s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:58 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee is being set with open permissions: ugo+rw Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:58 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:42:58 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:58 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.706s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.263s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Creating offline snapshot a467e822-8a49-49ae-a2de-a206efb70f8a of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:42:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-024a38e9-59d5-427a-83e9-9790dd944d31 tempest-VolumesSnapshotListTestJSON-110502385 None] Create snapshot completed successfully Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d5239f-297b-42a9-b940-c8b64b40a182]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:42:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:59 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:42:59 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:42:59 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:59 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a 1G Sep 03 13:42:59 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:42:59 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a 1G" returned: 0 in 0.446s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:42:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:42:59 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a Sep 03 13:42:59 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:00 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a" returned: 0 in 0.292s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:00 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a is being set with open permissions: ugo+rw Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:00 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a Sep 03 13:43:00 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:00 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.583s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.193s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Creating offline snapshot 5af14b66-fc9e-4905-9a74-191e88c17e78 of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:43:00 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-07cca162-8e6c-4f70-a94e-610df37539f3 tempest-SnapshotsActionsTest-23946986 None] Create snapshot completed successfully Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf44000-3131-4390-a748-bc44dcf2d5ce]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:00 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:43:00 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-a467e822-8a49-49ae-a2de-a206efb70f8a-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-a467e822-8a49-49ae-a2de-a206efb70f8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-a467e822-8a49-49ae-a2de-a206efb70f8a" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-a467e822-8a49-49ae-a2de-a206efb70f8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Deleting offline snapshot a467e822-8a49-49ae-a2de-a206efb70f8a of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] snapshot_file for this snap is: volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fbc8c-647e-4166-9f15-408fb6c1cc57]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.425s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 1G Sep 03 13:43:01 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:01 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a Sep 03 13:43:01 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:01 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a" returned: 0 in 0.416s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7581d6d0-9eee-4de8-a242-8f1d46071f9e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 1G" returned: 0 in 0.555s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:01 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:01 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 Sep 03 13:43:01 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:01 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a Sep 03 13:43:01 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:01 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 is being set with open permissions: ugo+rw Sep 03 13:43:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:01 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 Sep 03 13:43:01 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:02 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c5a8b0d7-49f9-477e-baea-fdf58188bce2 tempest-VolumesSnapshotListTestJSON-110502385 None] Create snapshot completed successfully Sep 03 13:43:02 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a" returned: 0 in 0.416s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:02 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a Sep 03 13:43:02 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:02 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.a467e822-8a49-49ae-a2de-a206efb70f8a" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-a467e822-8a49-49ae-a2de-a206efb70f8a" released by "_delete_snapshot" :: held 1.608s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_snapshot" :: held 1.637s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Created reservations ['0411294d-08a1-4fc2-888d-cd28ada348a4', '0ab43654-2ed3-495c-8bab-44b39e1e9000', '764f50da-4fbe-4398-b461-aa1d35bc2cf5', 'f91e7d2b-dcf8-41e1-bca1-9fa417de97a4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Delete snapshot completed successfully. Sep 03 13:43:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b54e9f5c-0148-4d2e-8895-9b90e7fabf68 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-a467e822-8a49-49ae-a2de-a206efb70f8a-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-5af14b66-fc9e-4905-9a74-191e88c17e78-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-5af14b66-fc9e-4905-9a74-191e88c17e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-5af14b66-fc9e-4905-9a74-191e88c17e78" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Creating offline snapshot 1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-5af14b66-fc9e-4905-9a74-191e88c17e78" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Deleting offline snapshot 5af14b66-fc9e-4905-9a74-191e88c17e78 of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] snapshot_file for this snap is: volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d39cc3-f85e-4d25-ab52-b7be1816facf]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c21ed13-71d6-4136-9c30-13d809d0e645]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:03 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:03 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:03 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 Sep 03 13:43:03 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:03 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.395s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:03 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:04 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 1G Sep 03 13:43:04 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58607d5-1fe1-4643-8749-565c07552751]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:04 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:43:04 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:04 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.387s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:04 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 Sep 03 13:43:04 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:04 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 1G" returned: 0 in 0.517s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:04 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 Sep 03 13:43:04 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:04 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" returned: 0 in 0.337s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:04 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 is being set with open permissions: ugo+rw Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:04 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 Sep 03 13:43:04 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:04 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78" returned: 0 in 0.474s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:04 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78 Sep 03 13:43:04 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:05 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.652s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:05 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.5af14b66-fc9e-4905-9a74-191e88c17e78" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-5af14b66-fc9e-4905-9a74-191e88c17e78" released by "_delete_snapshot" :: held 1.627s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-abaa6780-a419-4dbd-b62c-698d88e8fc4b tempest-SnapshotsActionsTest-23946986 None] Create snapshot completed successfully Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" released by "delete_snapshot" :: held 1.689s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Created reservations ['5ce6d55e-bff2-43f7-90d4-af79a3edf444', 'd26ada7b-0cb6-4a03-9f20-e4ba6c4858e5', 'd68800ff-e46d-4914-a053-35406eb9d970', '9ca9333a-dcfe-4fea-974d-434e9ce7157d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Delete snapshot completed successfully. Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f1c07f39-8077-4d29-8ee7-c6823b26af39 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-5af14b66-fc9e-4905-9a74-191e88c17e78-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-c87c9e35-87c4-4d0c-8b94-233a21efadee-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-c87c9e35-87c4-4d0c-8b94-233a21efadee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-c87c9e35-87c4-4d0c-8b94-233a21efadee" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-c87c9e35-87c4-4d0c-8b94-233a21efadee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Deleting offline snapshot c87c9e35-87c4-4d0c-8b94-233a21efadee of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] snapshot_file for this snap is: volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[635c94fa-20c4-4438-b462-f617864e989a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Deleting offline snapshot 1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] snapshot_file for this snap is: volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:05 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:43:05 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b3965-0da1-4bae-9c74-f41b33c91819]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:06 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 Sep 03 13:43:06 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:06 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.447s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[34349099-b0af-414b-8f01-6c5b27248539]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:06 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:06 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:43:06 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3811e6-c704-4caa-b6c5-d6b4b20ba320]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:06 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:06 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:06 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.427s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:06 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:43:06 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:06 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:06 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 Sep 03 13:43:06 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:07 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.438s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:07 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee Sep 03 13:43:07 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:07 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" returned: 0 in 0.456s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:07 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3 Sep 03 13:43:07 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:07 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.c87c9e35-87c4-4d0c-8b94-233a21efadee" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-c87c9e35-87c4-4d0c-8b94-233a21efadee" released by "_delete_snapshot" :: held 1.693s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" released by "delete_snapshot" :: held 1.728s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Created reservations ['dfc065db-57b7-4c0a-995c-ba072bdfd6c7', 'b18c78a6-5c8c-42d1-8ec6-4e816fa015fd', '483ccf45-b8f3-4e80-b777-e835a733d375', '86396232-9f95-4c83-a0cf-0532efd22c18'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:07 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3" released by "_delete_snapshot" :: held 1.700s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Delete snapshot completed successfully. Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_snapshot" :: held 1.733s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b5b51f0-4bc9-45e8-9fab-f1469e8d3874 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-c87c9e35-87c4-4d0c-8b94-233a21efadee-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Created reservations ['6a988af2-f1ad-4a47-a97e-a7408a680929', '1585c951-39bf-45a7-a8a9-0833fbf14c9c', 'a1f4f994-9bcd-4212-85fc-e2121fd8b071', '065c4b30-9842-4540-8538-81940d6e75a1'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Delete snapshot completed successfully. Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-79059231-d413-45eb-aa3e-972ef6e6e0ec tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-1eb2f93b-f898-47e7-9a93-6ae58d6b22b3-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Deleting offline snapshot 9bd9ee76-2748-48e0-bc70-5d51fd9fff4c of volume 437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] snapshot_file for this snap is: volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e926d-5894-4c1a-9ac0-a8916a3189d1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:08 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:43:08 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:08 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Creating offline snapshot 5967d0f6-ff13-4fb6-bb71-c29de51e348b of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.485s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437e356d-3a31-4f22-a92a-3974b3da8dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c920df-e061-42dc-aa79-fd983299e352]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee66d36a-26fa-4230-852f-91d56cd53ae9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:08 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:08 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:08 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 Sep 03 13:43:08 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:08 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:08 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5" returned: 0 in 0.411s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:08 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b 1G Sep 03 13:43:08 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:08 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:43:08 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:09 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:09 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c Sep 03 13:43:09 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:09 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b 1G" returned: 0 in 0.597s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:09 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b Sep 03 13:43:09 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:09 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5.9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c" released by "_delete_snapshot" :: held 1.788s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" released by "delete_snapshot" :: held 1.857s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Created reservations ['92353f52-4c2e-4e5d-84f2-1b1c8952c840', 'a488b8e6-5ce8-41b2-9b49-de7cc2d7351d', '3d73334b-79a6-4e95-9d3c-687cfa3202d0', 'e2b31905-3a11-40cb-856e-c5b072f82481'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:09 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Delete snapshot completed successfully. Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b" returned: 0 in 0.383s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:09 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b is being set with open permissions: ugo+rw Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4a88c678-f52f-4680-a190-3dfb33a1950a tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-9bd9ee76-2748-48e0-bc70-5d51fd9fff4c-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:09 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b Sep 03 13:43:09 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-437e356d-3a31-4f22-a92a-3974b3da8dc5-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-437e356d-3a31-4f22-a92a-3974b3da8dc5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:10 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" acquired by "delete_volume" :: waited 0.050s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b1ed5321-65e4-462a-b7a1-3f2e7e193722 tempest-SnapshotsActionsTest-23946986 None] Create snapshot completed successfully Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[12976a33-d809-4d67-bbe8-da7d507e74f5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:10 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 Sep 03 13:43:10 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-5967d0f6-ff13-4fb6-bb71-c29de51e348b-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-5967d0f6-ff13-4fb6-bb71-c29de51e348b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-5967d0f6-ff13-4fb6-bb71-c29de51e348b" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-5967d0f6-ff13-4fb6-bb71-c29de51e348b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Deleting offline snapshot 5967d0f6-ff13-4fb6-bb71-c29de51e348b of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] snapshot_file for this snap is: volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b579f-5e08-420b-8be6-36064f31f30a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:10 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5" returned: 0 in 0.460s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:10 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5 Sep 03 13:43:10 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:10 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b Sep 03 13:43:10 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:10 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-437e356d-3a31-4f22-a92a-3974b3da8dc5" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-quobyte-437e356d-3a31-4f22-a92a-3974b3da8dc5" released by "delete_volume" :: held 0.828s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Created reservations ['3a027a7f-63f8-4acf-b3fc-0b2714b595e6', '452c68cb-1c39-4172-89a5-5f0fbb7c34a2', '84844c2b-34ec-4bf0-b2d6-3e90aa4585dd', '28fb9198-4768-4c2e-85c8-f7bf3475469d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:11 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d91ea-9130-437d-b4c0-b53b69ad29a0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:11 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:43:11 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:11 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:11 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:11 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.325s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:43:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Deleted volume successfully. Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f565ddb-5c44-4e0a-a21b-fc66b2e3ab73 tempest-VolumesSnapshotListTestJSON-110502385 None] Lock "cinder-437e356d-3a31-4f22-a92a-3974b3da8dc5-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:11 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.494s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:11 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b Sep 03 13:43:11 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:12 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b" returned: 0 in 0.417s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:12 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b Sep 03 13:43:12 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:12 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.5967d0f6-ff13-4fb6-bb71-c29de51e348b" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-5967d0f6-ff13-4fb6-bb71-c29de51e348b" released by "_delete_snapshot" :: held 1.752s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_snapshot" :: held 1.782s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Created reservations ['270519bf-f56f-48e6-b3e4-68d4bfd5c0e2', '1e14b9a3-5325-4261-b612-ea6c4d9220f3', '71f3d612-011f-4381-8031-0941016c667d', 'f7203c27-f6a3-4f59-b585-d3dc766f0450'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Delete snapshot completed successfully. Sep 03 13:43:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-36c722fd-cd83-4621-926c-03560d95b42b tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-5967d0f6-ff13-4fb6-bb71-c29de51e348b-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Creating offline snapshot 3c0f23f5-3d8d-49df-880a-e15c188cab30 of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ece709-c1f0-42b5-9ac2-abd94d238c50]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:13 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:13 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:13 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.405s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:13 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 1G Sep 03 13:43:13 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:14 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 1G" returned: 0 in 0.503s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:14 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 Sep 03 13:43:14 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:14 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:14 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 is being set with open permissions: ugo+rw Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:14 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 Sep 03 13:43:14 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:14 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.683s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6c9ff115-d270-4aff-a7b3-806e4f621192 tempest-SnapshotsActionsTest-23946986 None] Create snapshot completed successfully Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-3c0f23f5-3d8d-49df-880a-e15c188cab30-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-3c0f23f5-3d8d-49df-880a-e15c188cab30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Acquiring lock "cinder-quobyte-3c0f23f5-3d8d-49df-880a-e15c188cab30" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-3c0f23f5-3d8d-49df-880a-e15c188cab30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Deleting offline snapshot 3c0f23f5-3d8d-49df-880a-e15c188cab30 of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] snapshot_file for this snap is: volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d30abd-7c85-4b0d-8dd7-14f98f172a84]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:15 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 Sep 03 13:43:15 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:15 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[11983f33-ae64-4c81-acb1-d8eacb01ac6c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:16 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:16 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:16 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.399s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:16 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 Sep 03 13:43:16 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:16 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30" returned: 0 in 0.498s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:16 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30 Sep 03 13:43:16 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:17 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.3c0f23f5-3d8d-49df-880a-e15c188cab30" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-3c0f23f5-3d8d-49df-880a-e15c188cab30" released by "_delete_snapshot" :: held 1.737s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_snapshot" :: held 1.764s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Created reservations ['6b526a52-5328-4162-8755-86b8075ac0b3', '7e1b425c-2191-4649-8b99-840284c395bd', '438705a3-2ac5-48df-9e7c-bcca3da1d922', 'ce6a7b13-dda6-4ce5-981b-185f6bd14022'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Delete snapshot completed successfully. Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7cb16143-ac1a-4b45-9534-a873835f8de7 tempest-SnapshotsActionsTest-987845417 None] Lock "cinder-3c0f23f5-3d8d-49df-880a-e15c188cab30-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "cinder-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "cinder-quobyte-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Deleting offline snapshot eb84fec9-efd5-4fd4-87ea-a4c7d96e795c of volume 02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] snapshot_file for this snap is: volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c7dc76-a850-49ff-a026-79a15dfe3cdd]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:18 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:18 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:18 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.459s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02366aee-0b32-4db0-a5eb-8a42379b89af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd6e16-a17a-47a6-aa43-82c7388dc0fb]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:18 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af Sep 03 13:43:18 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:19 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af" returned: 0 in 0.508s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:19 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:19 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:19 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.397s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:19 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c Sep 03 13:43:19 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:19 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af.eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c" released by "_delete_snapshot" :: held 1.783s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_snapshot" :: held 1.811s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Created reservations ['dccbf8fa-95cc-4aa6-8213-9eb606ae3c78', 'ee1c9fcc-ea7d-4fce-b156-7b446faa03d1', '837d10d6-7626-4570-b687-7800415efc68', 'd9994f33-08a3-48c2-a13f-7b99f3f975ce'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Delete snapshot completed successfully. Sep 03 13:43:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-42d75912-94de-442b-8374-91e158f8cee6 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-eb84fec9-efd5-4fd4-87ea-a4c7d96e795c-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "cinder-02366aee-0b32-4db0-a5eb-8a42379b89af-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-02366aee-0b32-4db0-a5eb-8a42379b89af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b690e0-0794-4e2a-aba9-0669851d51a5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:20 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af Sep 03 13:43:20 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:20 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:20 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af Sep 03 13:43:20 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:21 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-02366aee-0b32-4db0-a5eb-8a42379b89af" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-quobyte-02366aee-0b32-4db0-a5eb-8a42379b89af" released by "delete_volume" :: held 0.795s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Created reservations ['84d77b30-697e-4e8f-bbe2-5be6e4b27845', '66911715-5099-4801-b53c-963ed353176e', '8bbb2a01-d9b3-44d9-a833-70d80a90b2c2', 'cd47a12b-3069-49e8-9295-ddbb806becc2'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:21 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:43:21 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:21 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.404s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:43:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Deleted volume successfully. Sep 03 13:43:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a05465c7-dbd7-42c8-9def-5ab4d7531c22 tempest-SnapshotsActionsTest-23946986 None] Lock "cinder-02366aee-0b32-4db0-a5eb-8a42379b89af-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (c4cfeb46-ca05-4323-87b8-4222f5bed6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4971bf9-5123-4719-854d-a46a9c8c26fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4971bf9-5123-4719-854d-a46a9c8c26fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-857959871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf348ec2-6347-4e96-8ade-8d32f92d9e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:29Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(352b439e-8091-4234-bba9-b8c51e40a5e6),volume_type_id=352b439e-8091-4234-bba9-b8c51e40a5e6)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5caab0-42dc-4f03-803c-dd5c51dd6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5caab0-42dc-4f03-803c-dd5c51dd6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bd576-f678-4779-a690-ee211dd9f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bd576-f678-4779-a690-ee211dd9f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf348ec2-6347-4e96-8ade-8d32f92d9e52', 'volume_name': 'volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f1d03e-5d50-4c40-8cff-b1a40bce3d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f1d03e-5d50-4c40-8cff-b1a40bce3d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf15f67-2c8e-4093-83bb-186eea94a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume bf348ec2-6347-4e96-8ade-8d32f92d9e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52', 'volume_size': 1} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-857959871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf348ec2-6347-4e96-8ade-8d32f92d9e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:29Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(352b439e-8091-4234-bba9-b8c51e40a5e6),volume_type_id=352b439e-8091-4234-bba9-b8c51e40a5e6)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Creating volume bf348ec2-6347-4e96-8ade-8d32f92d9e52 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:43:29 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:43:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:29 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 1073741824 Sep 03 13:43:29 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (84fe8c21-dc3d-4dcd-b12f-dd1bcec528aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85234d4e-5b5c-4d13-9083-fbb82c88cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85234d4e-5b5c-4d13-9083-fbb82c88cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983537433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d16d0-720d-4448-b3d8-4a65e4061f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:30Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271091e9-3d3b-405f-890f-bd581abb41ee),volume_type_id=271091e9-3d3b-405f-890f-bd581abb41ee)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98168a4f-95a6-4842-aff1-c55424df628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98168a4f-95a6-4842-aff1-c55424df628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0308e6e9-342a-42de-bab5-e7dc51fbf8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0308e6e9-342a-42de-bab5-e7dc51fbf8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5d16d0-720d-4448-b3d8-4a65e4061f76', 'volume_name': 'volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e655bf93-0999-490e-849f-10c3da63ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e655bf93-0999-490e-849f-10c3da63ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633dd713-3aff-4e1a-a3ce-457815a216c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume dd5d16d0-720d-4448-b3d8-4a65e4061f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76', 'volume_size': 1} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 1073741824" returned: 0 in 0.742s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:30 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 Sep 03 13:43:30 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:30 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52" returned: 0 in 0.396s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983537433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d16d0-720d-4448-b3d8-4a65e4061f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:30Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271091e9-3d3b-405f-890f-bd581abb41ee),volume_type_id=271091e9-3d3b-405f-890f-bd581abb41ee)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Creating volume dd5d16d0-720d-4448-b3d8-4a65e4061f76 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:43:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf15f67-2c8e-4093-83bb-186eea94a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 1073741824 Sep 03 13:43:30 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1db5f4-4197-45df-b913-91539380acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 (bf348ec2-6347-4e96-8ade-8d32f92d9e52): created successfully Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1db5f4-4197-45df-b913-91539380acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (c4cfeb46-ca05-4323-87b8-4222f5bed6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5e1060f6-cb47-4de7-8087-71dfd3c03c8e tempest-TestInstancesWithCinderVolumes-1777125652 None] Created volume successfully. Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (72a3d973-9d4e-4eb4-a640-324d4c8bcf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bd9d8a-9e4e-4262-8edb-40b549010f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bd9d8a-9e4e-4262-8edb-40b549010f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-500090345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:31Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec041c3-45f1-468c-8dbf-bacb07e0bb8f),volume_type_id=dec041c3-45f1-468c-8dbf-bacb07e0bb8f)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516bb7e-1214-4ce3-a04a-4aad877dee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516bb7e-1214-4ce3-a04a-4aad877dee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d3ace8-732e-4558-86e8-3d22679f8bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:43:31 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 1073741824" returned: 0 in 0.571s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:31 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 Sep 03 13:43:31 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d3ace8-732e-4558-86e8-3d22679f8bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268', 'volume_name': 'volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268', 'volume_size': 1, 'image_id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--458409549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '023367d948dc468c9f48dd297811bd33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'created_at': datetime.datetime(2026, 9, 3, 11, 43, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346e252e-c240-4d56-809f-6e588250da03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346e252e-c240-4d56-809f-6e588250da03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d044c1-8823-4f45-b546-4b9c135c320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268', 'volume_size': 1, 'image_id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--458409549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '023367d948dc468c9f48dd297811bd33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'created_at': datetime.datetime(2026, 9, 3, 11, 43, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba/file', 'properties': {}}, 'image_service': } Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Trying to clone a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 from image e23bbb10-dd09-47a1-bbfa-cb099431b8ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:43:31 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633dd713-3aff-4e1a-a3ce-457815a216c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec0b038-a69c-44c3-a1b2-44fcc5822dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 (dd5d16d0-720d-4448-b3d8-4a65e4061f76): created successfully Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec0b038-a69c-44c3-a1b2-44fcc5822dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (84fe8c21-dc3d-4dcd-b12f-dd1bcec528aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a3b1fd53-54fd-4cc5-997c-499004074a35 tempest-TestInstancesWithCinderVolumes-1777125652 None] Created volume successfully. Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:33 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:43:33 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:34 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:43:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:43:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:43:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:43:35 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD, size 20.69 MB, duration 3.85 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:43:35 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Image download 20.69 MB at 5.38 MB/s Sep 03 13:43:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[69710168-f626-4655-8df7-012512f8ea40]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:35 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD Sep 03 13:43:35 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:35 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Temporary image e23bbb10-dd09-47a1-bbfa-cb099431b8ba is fetched for user 80eee806654849bc90df02df48a45168. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=145,cinder:UPDATE=181,cinder:INSERT=39,cinder:DELETE=15 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79965e8-e51f-4c47-8e92-22647f433912]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:36 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD Sep 03 13:43:36 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:36 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-500090345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023367d948dc468c9f48dd297811bd33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:31Z,use_quota=True,user_id='80eee806654849bc90df02df48a45168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec041c3-45f1-468c-8dbf-bacb07e0bb8f),volume_type_id=dec041c3-45f1-468c-8dbf-bacb07e0bb8f)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Creating volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:43:36 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:43:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:36 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1073741824 Sep 03 13:43:36 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:37 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1073741824" returned: 0 in 0.544s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:37 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 Sep 03 13:43:37 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:37 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" returned: 0 in 0.328s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Attempting download of e23bbb10-dd09-47a1-bbfa-cb099431b8ba ((None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}])) to volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15509fd0-27cf-4774-836d-4afec888cdfd]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:37 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym Sep 03 13:43:37 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:37 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:38 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym Sep 03 13:43:38 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:38 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym" returned: 1 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_8nox21ym' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3124189-3314-4c55-a446-ad4d7a7a3b2a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:38 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD Sep 03 13:43:38 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:38 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] e23bbb10-dd09-47a1-bbfa-cb099431b8ba was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:43:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:38 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 Sep 03 13:43:38 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:40 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" returned: 0 in 2.079s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:40 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e23bbb10-dd09-47a1-bbfa-cb099431b8ba_o2si_dvqdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:43:40 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Converted 112.00 MB image at 53.84 MB/s Sep 03 13:43:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:40 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1G Sep 03 13:43:40 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:41 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 1G" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Downloaded image e23bbb10-dd09-47a1-bbfa-cb099431b8ba ((None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}])) to volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Temporary image e23bbb10-dd09-47a1-bbfa-cb099431b8ba for user 80eee806654849bc90df02df48a45168 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Marking volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Copying metadata from image e23bbb10-dd09-47a1-bbfa-cb099431b8ba to a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Creating volume glance metadata for volume a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 backed by image e23bbb10-dd09-47a1-bbfa-cb099431b8ba with: {'image_id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'image_name': 'tempest-scenario-img--458409549', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d044c1-8823-4f45-b546-4b9c135c320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268', 'volume_size': 1, 'image_id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--458409549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '023367d948dc468c9f48dd297811bd33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e23bbb10-dd09-47a1-bbfa-cb099431b8ba', 'created_at': datetime.datetime(2026, 9, 3, 11, 43, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e23bbb10-dd09-47a1-bbfa-cb099431b8ba/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa50261c-0a01-4496-9706-1d19807c6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:41 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Volume volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 (a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268): created successfully Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa50261c-0a01-4496-9706-1d19807c6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Flow 'volume_create_manager' (72a3d973-9d4e-4eb4-a640-324d4c8bcf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e31e3f07-e382-4adf-85a6-be949b675909 tempest-TestInstancesWithCinderVolumes-1777125652 None] Created volume successfully. Sep 03 13:43:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3a16f096-391e-44b4-93c9-5c3b31869f2e req-466a34f1-91e3-4e71-a656-fd90f0b45d9d tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3a16f096-391e-44b4-93c9-5c3b31869f2e req-466a34f1-91e3-4e71-a656-fd90f0b45d9d tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-3a16f096-391e-44b4-93c9-5c3b31869f2e req-466a34f1-91e3-4e71-a656-fd90f0b45d9d tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-3a16f096-391e-44b4-93c9-5c3b31869f2e req-466a34f1-91e3-4e71-a656-fd90f0b45d9d tempest-TestInstancesWithCinderVolumes-1777125652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ae505a8-5d38-4698-8827-3ee8debf93d8', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:43:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-3a16f096-391e-44b4-93c9-5c3b31869f2e req-466a34f1-91e3-4e71-a656-fd90f0b45d9d tempest-TestInstancesWithCinderVolumes-1777125652 None] attachment_update completed successfully. Sep 03 13:43:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:INSERT=6,cinder:UPDATE=6,cinder:SELECT=8 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:43:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=90,cinder:UPDATE=77,cinder:INSERT=28,cinder:DELETE=6 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Flow 'volume_create_manager' (569efaf9-9a38-4227-b1b0-a2df31c062be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee78c0b-c0d7-4e58-993a-b25b269e9fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee78c0b-c0d7-4e58-993a-b25b269e9fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-656396360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635726c0-3f42-4140-bc12-507c9117fcc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2df0760c6c4386bcb37bf4494a95cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:56Z,use_quota=True,user_id='26b009cf04a845aea134583e8c11dff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad074d-ea1f-4db6-88ff-cc8b538cb5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad074d-ea1f-4db6-88ff-cc8b538cb5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de922a84-c23b-445f-af72-e3feea3b9fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de922a84-c23b-445f-af72-e3feea3b9fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635726c0-3f42-4140-bc12-507c9117fcc4', 'volume_name': 'volume-635726c0-3f42-4140-bc12-507c9117fcc4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea25bc6-66c8-45b0-8dd7-dd8836caaa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea25bc6-66c8-45b0-8dd7-dd8836caaa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909797c5-36ef-4207-b500-9951befdcf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Volume 635726c0-3f42-4140-bc12-507c9117fcc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635726c0-3f42-4140-bc12-507c9117fcc4', 'volume_size': 1} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-656396360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635726c0-3f42-4140-bc12-507c9117fcc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2df0760c6c4386bcb37bf4494a95cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:43:56Z,use_quota=True,user_id='26b009cf04a845aea134583e8c11dff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Creating volume 635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:43:56 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:43:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:56 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 1073741824 Sep 03 13:43:56 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:57 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 1073741824" returned: 0 in 0.718s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:57 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 Sep 03 13:43:57 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:57 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4" returned: 0 in 0.380s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909797c5-36ef-4207-b500-9951befdcf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635726c0-3f42-4140-bc12-507c9117fcc4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aed8e2-df40-44ae-b199-f04ee5d22742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:43:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Volume volume-635726c0-3f42-4140-bc12-507c9117fcc4 (635726c0-3f42-4140-bc12-507c9117fcc4): created successfully Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aed8e2-df40-44ae-b199-f04ee5d22742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:43:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Flow 'volume_create_manager' (569efaf9-9a38-4227-b1b0-a2df31c062be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:43:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-51cb87af-d536-4b35-912b-77a33e382e66 tempest-SnapshotMetadataTestJSON-371986177 None] Created volume successfully. Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Creating offline snapshot 522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 of volume 635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b019b829-8c81-4187-9b16-45a6558eac85]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:59 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 Sep 03 13:43:59 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:43:59 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4" returned: 0 in 0.726s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:43:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:43:59 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 1G Sep 03 13:43:59 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:00 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 1G" returned: 0 in 0.651s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635726c0-3f42-4140-bc12-507c9117fcc4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:00 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635726c0-3f42-4140-bc12-507c9117fcc4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 Sep 03 13:44:00 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:00 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635726c0-3f42-4140-bc12-507c9117fcc4 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" returned: 0 in 0.339s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:00 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 is being set with open permissions: ugo+rw Sep 03 13:44:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:00 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 Sep 03 13:44:00 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:01 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:01 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info Sep 03 13:44:01 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:01 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info is being set with open permissions: ugo+rw Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:01 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info Sep 03 13:44:01 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:01 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.info" returned: 0 in 0.305s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:01 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ad897071-9638-4f97-9e77-f0466217c17b tempest-SnapshotMetadataTestJSON-371986177 None] Create snapshot completed successfully Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "cinder-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "cinder-quobyte-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Deleting offline snapshot 522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 of volume 635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] snapshot_file for this snap is: volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cd4b0e-b555-4ac5-b384-6148ebe7873f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:03 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 Sep 03 13:44:03 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:03 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-635726c0-3f42-4140-bc12-507c9117fcc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d8a7e-4f9d-40d4-ac55-205099b74647]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:03 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 Sep 03 13:44:03 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:04 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4" returned: 0 in 0.387s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:04 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 Sep 03 13:44:04 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:04 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:04 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6 Sep 03 13:44:04 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:04 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4.522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6" released by "_delete_snapshot" :: held 1.520s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" released by "delete_snapshot" :: held 1.553s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Created reservations ['8188b4c2-0879-46f5-99b9-b3cd31c33e08', '1e836f83-11dc-4f00-a474-7beb1b700719', 'acfc9b52-0ef9-4f83-9db9-b2815fa03c43', 'b0152295-ed6b-4360-918a-1d97d6e84f4c'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Delete snapshot completed successfully. Sep 03 13:44:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53bbc44c-4fa9-4cf4-b5dc-efacd164d803 tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-522d9a3e-cbcc-433b-8fdb-b2f2e3dcf5e6-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "cinder-635726c0-3f42-4140-bc12-507c9117fcc4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-635726c0-3f42-4140-bc12-507c9117fcc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c09e1db-36c6-45a8-b47b-9ac525c2da98]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:05 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 Sep 03 13:44:05 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:05 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4" returned: 0 in 0.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:05 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4 Sep 03 13:44:05 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:06 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-635726c0-3f42-4140-bc12-507c9117fcc4" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-quobyte-635726c0-3f42-4140-bc12-507c9117fcc4" released by "delete_volume" :: held 0.686s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Created reservations ['dfeb6371-d3c2-413b-9106-4085132b0b0c', 'd8a9d07e-257b-4994-95e6-5a3e0a33c3a2', 'f61866f9-d69d-427f-8ddb-6882b4da16b0', '07532e20-7a7a-4adf-8183-9dd685f42463'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:06 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:06 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:06 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Deleted volume successfully. Sep 03 13:44:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-51c5fb7a-89e8-4dd9-86c8-5f71b98b033b tempest-SnapshotMetadataTestJSON-371986177 None] Lock "cinder-635726c0-3f42-4140-bc12-507c9117fcc4-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Flow 'volume_create_manager' (0bc4405e-22d9-4d90-b359-d191cefbc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9706f1db-be08-46f1-b77f-4d8a7d3e0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9706f1db-be08-46f1-b77f-4d8a7d3e0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1897248978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b568828-861d-45da-abee-26006ca48832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61aeb7b59434bbfaa0bcd5f594d153a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:10Z,use_quota=True,user_id='1583b7df9f6941f887d5589f06b98d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58dd3a5-ada3-4857-8e05-212f626930be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58dd3a5-ada3-4857-8e05-212f626930be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665cea79-95fa-4b75-a2a9-c2c27af9e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665cea79-95fa-4b75-a2a9-c2c27af9e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b568828-861d-45da-abee-26006ca48832', 'volume_name': 'volume-9b568828-861d-45da-abee-26006ca48832', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7095f6d-ecdf-4db9-95f8-fa6f56666406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7095f6d-ecdf-4db9-95f8-fa6f56666406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3f5815-4f2c-436a-956e-42bebfcebbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Volume 9b568828-861d-45da-abee-26006ca48832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b568828-861d-45da-abee-26006ca48832', 'volume_size': 1} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1897248978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b568828-861d-45da-abee-26006ca48832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61aeb7b59434bbfaa0bcd5f594d153a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:10Z,use_quota=True,user_id='1583b7df9f6941f887d5589f06b98d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Creating volume 9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:09 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:09 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 1073741824 Sep 03 13:44:09 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:10 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 1073741824" returned: 0 in 0.450s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:10 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:10 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:10 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3f5815-4f2c-436a-956e-42bebfcebbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b568828-861d-45da-abee-26006ca48832', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cd95bb-a078-4942-9ff6-cf5a66bac448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Volume volume-9b568828-861d-45da-abee-26006ca48832 (9b568828-861d-45da-abee-26006ca48832): created successfully Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cd95bb-a078-4942-9ff6-cf5a66bac448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Flow 'volume_create_manager' (0bc4405e-22d9-4d90-b359-d191cefbc3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-52e7affe-af8b-4f4b-8437-c9a90420fbf0 tempest-VolumesCloneTest-1753567165 None] Created volume successfully. Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Flow 'volume_create_manager' (d5ef5cff-f2dc-4a1d-98dc-b56b8d966c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdd1d9e-a115-4ffd-b8d7-38cdff879643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdd1d9e-a115-4ffd-b8d7-38cdff879643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-893772294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3277a86b-452d-4890-bb6c-34824115c3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61aeb7b59434bbfaa0bcd5f594d153a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9b568828-861d-45da-abee-26006ca48832,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:12Z,use_quota=True,user_id='1583b7df9f6941f887d5589f06b98d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83476a7d-ed44-46db-9ab2-77201aca9867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83476a7d-ed44-46db-9ab2-77201aca9867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46807216-98a8-4746-814c-83d15e09fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46807216-98a8-4746-814c-83d15e09fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3277a86b-452d-4890-bb6c-34824115c3cd', 'volume_name': 'volume-3277a86b-452d-4890-bb6c-34824115c3cd', 'volume_size': 2, 'source_volid': '9b568828-861d-45da-abee-26006ca48832', 'source_volstatus': 'available'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef5c70b-09f0-47e8-b55c-4f0157144461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef5c70b-09f0-47e8-b55c-4f0157144461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f986dbb-e1e7-4514-9e37-169deb2e30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Volume 3277a86b-452d-4890-bb6c-34824115c3cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3277a86b-452d-4890-bb6c-34824115c3cd', 'volume_size': 2, 'source_volid': '9b568828-861d-45da-abee-26006ca48832', 'source_volstatus': 'available'} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:12 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Cloning volume 9b568828-861d-45da-abee-26006ca48832 to volume 3277a86b-452d-4890-bb6c-34824115c3cd Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Creating offline snapshot 5abd9d07-1563-4f58-bfbc-75b234440972 of volume 9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad785f6-da0e-4157-9b19-685fbebd9e4a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:12 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:12 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:12 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.374s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:12 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 1G Sep 03 13:44:12 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:13 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 1G" returned: 0 in 0.405s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b568828-861d-45da-abee-26006ca48832 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:13 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b568828-861d-45da-abee-26006ca48832 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:13 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:13 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b568828-861d-45da-abee-26006ca48832 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.295s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:13 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 is being set with open permissions: ugo+rw Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:13 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:13 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:13 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:13 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info Sep 03 13:44:13 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:13 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:13 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info is being set with open permissions: ugo+rw Sep 03 13:44:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:13 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info Sep 03 13:44:13 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Flow 'volume_create_manager' (c8caa1b2-d9aa-4e39-9835-89ed6f1ab56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4e638e-e843-432f-866b-fcb7546be5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4e638e-e843-432f-866b-fcb7546be5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-603335748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00318188-ac57-4f95-a2f1-4e06355e5493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e39e1f19b3447b88583f0626e45ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:14Z,use_quota=True,user_id='be8db7d5aa8f485d852bf05a9b7243c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5678b57-a09f-472b-a5f7-790fc2e3e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5678b57-a09f-472b-a5f7-790fc2e3e248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46184b19-aec8-4d5e-af2e-104514820a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46184b19-aec8-4d5e-af2e-104514820a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00318188-ac57-4f95-a2f1-4e06355e5493', 'volume_name': 'volume-00318188-ac57-4f95-a2f1-4e06355e5493', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8becfb82-561e-4ecb-b9d5-33f9d7b18af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8becfb82-561e-4ecb-b9d5-33f9d7b18af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b23e4f-aa25-4724-beb7-b231c4dba7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Volume 00318188-ac57-4f95-a2f1-4e06355e5493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00318188-ac57-4f95-a2f1-4e06355e5493', 'volume_size': 1} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:14 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.info" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] snapshot: 5abd9d07-1563-4f58-bfbc-75b234440972, volume: 3277a86b-452d-4890-bb6c-34824115c3cd, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d00ed-7816-4037-aa29-981293db91c6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:14 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:14 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:14 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.356s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b568828-861d-45da-abee-26006ca48832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68881f-3d3c-4208-b8d2-33d759c4faf0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:14 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:14 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:14 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:44:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:14 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd Sep 03 13:44:14 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:19 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd" returned: 0 in 4.598s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:44:19 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Converted 1024.00 MB image at 222.65 MB/s Sep 03 13:44:19 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd is being set with open permissions: ugo+rw Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:19 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd Sep 03 13:44:19 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:19 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" released by "_copy_volume_from_snapshot" :: held 5.620s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-quobyte-5abd9d07-1563-4f58-bfbc-75b234440972" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-5abd9d07-1563-4f58-bfbc-75b234440972" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Deleting offline snapshot 5abd9d07-1563-4f58-bfbc-75b234440972 of volume 9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] snapshot_file for this snap is: volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9429b483-0639-432f-8c33-25afbaa92137]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:19 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:19 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:20 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b568828-861d-45da-abee-26006ca48832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c9d9f-9dd5-4dc4-b313-175f2c1eec97]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:20 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:20 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:20 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.515s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:20 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:20 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:21 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:21 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972 Sep 03 13:44:21 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:21 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832.5abd9d07-1563-4f58-bfbc-75b234440972" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-5abd9d07-1563-4f58-bfbc-75b234440972" released by "_delete_snapshot" :: held 1.523s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.156s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.249s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-603335748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00318188-ac57-4f95-a2f1-4e06355e5493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e39e1f19b3447b88583f0626e45ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:14Z,use_quota=True,user_id='be8db7d5aa8f485d852bf05a9b7243c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Creating volume 00318188-ac57-4f95-a2f1-4e06355e5493 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:21 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:21 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 1073741824 Sep 03 13:44:21 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f986dbb-e1e7-4514-9e37-169deb2e30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3277a86b-452d-4890-bb6c-34824115c3cd', 'volume_size': 2, 'source_volid': '9b568828-861d-45da-abee-26006ca48832', 'source_volstatus': 'available'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6360f7a-42de-41ce-b574-8b409a5fb6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Volume volume-3277a86b-452d-4890-bb6c-34824115c3cd (3277a86b-452d-4890-bb6c-34824115c3cd): created successfully Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6360f7a-42de-41ce-b574-8b409a5fb6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Flow 'volume_create_manager' (d5ef5cff-f2dc-4a1d-98dc-b56b8d966c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ddd7c9e4-4c0f-4cbf-98f1-b3d97f8d523e tempest-VolumesCloneTest-1753567165 None] Created volume successfully. Sep 03 13:44:21 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 1073741824" returned: 0 in 0.425s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:21 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 Sep 03 13:44:21 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-3277a86b-452d-4890-bb6c-34824115c3cd-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-3277a86b-452d-4890-bb6c-34824115c3cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:22 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493" returned: 0 in 0.289s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b23e4f-aa25-4724-beb7-b231c4dba7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00318188-ac57-4f95-a2f1-4e06355e5493', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150e3292-6278-428b-acdb-6443809c0b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:22 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Volume volume-00318188-ac57-4f95-a2f1-4e06355e5493 (00318188-ac57-4f95-a2f1-4e06355e5493): created successfully Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150e3292-6278-428b-acdb-6443809c0b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Flow 'volume_create_manager' (c8caa1b2-d9aa-4e39-9835-89ed6f1ab56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd6b1e-a9f5-4985-8b0d-23b6980be5b4]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-49e66535-132e-4b01-b7fa-ddfaba7f4c5b tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Created volume successfully. Sep 03 13:44:22 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd Sep 03 13:44:22 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:22 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd" returned: 0 in 0.378s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:22 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd Sep 03 13:44:22 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8c077c14-2ff4-4ee2-a6ef-c92e2d3f7b6b req-fba2323c-05f8-4dc0-b195-07a44bfe8296 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8c077c14-2ff4-4ee2-a6ef-c92e2d3f7b6b req-fba2323c-05f8-4dc0-b195-07a44bfe8296 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8c077c14-2ff4-4ee2-a6ef-c92e2d3f7b6b req-fba2323c-05f8-4dc0-b195-07a44bfe8296 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-8c077c14-2ff4-4ee2-a6ef-c92e2d3f7b6b req-fba2323c-05f8-4dc0-b195-07a44bfe8296 tempest-TestInstancesWithCinderVolumes-1777125652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0afb0e0e-5596-44da-8c4d-13c250445bfc', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:44:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-8c077c14-2ff4-4ee2-a6ef-c92e2d3f7b6b req-fba2323c-05f8-4dc0-b195-07a44bfe8296 tempest-TestInstancesWithCinderVolumes-1777125652 None] attachment_update completed successfully. Sep 03 13:44:22 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3277a86b-452d-4890-bb6c-34824115c3cd" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-3277a86b-452d-4890-bb6c-34824115c3cd" released by "delete_volume" :: held 0.700s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:22 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Created reservations ['98360d30-3925-4630-bac2-ea002a0f2ff9', 'df942bf8-16f1-4cf9-a0ba-40ce61fec2e4', '0a011f7c-48ca-4e68-9724-60e3c715d441', '9917a65b-94f8-415e-bbca-af17c21b5d69'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:23 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:23 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:23 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Deleted volume successfully. Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f6c1ffe6-0c23-437c-bc62-bed4e97fbb00 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-3277a86b-452d-4890-bb6c-34824115c3cd-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-9b568828-861d-45da-abee-26006ca48832-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-9b568828-861d-45da-abee-26006ca48832-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "cinder-quobyte-9b568828-861d-45da-abee-26006ca48832" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-9b568828-861d-45da-abee-26006ca48832" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff6119c-1533-48ad-ad3d-ec67c3233481]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-49aa8eb6-7d57-451b-8360-8549e0574693 req-7d5b0545-8120-4f7e-9a0c-78bbb295297a tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-49aa8eb6-7d57-451b-8360-8549e0574693 req-7d5b0545-8120-4f7e-9a0c-78bbb295297a tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-49aa8eb6-7d57-451b-8360-8549e0574693 req-7d5b0545-8120-4f7e-9a0c-78bbb295297a tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:23 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:23 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-49aa8eb6-7d57-451b-8360-8549e0574693 req-7d5b0545-8120-4f7e-9a0c-78bbb295297a tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-00318188-ac57-4f95-a2f1-4e06355e5493', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e02cb8dd-1977-43d7-8f61-0b65aa273f1d', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:44:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-49aa8eb6-7d57-451b-8360-8549e0574693 req-7d5b0545-8120-4f7e-9a0c-78bbb295297a tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] attachment_update completed successfully. Sep 03 13:44:24 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:24 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832 Sep 03 13:44:24 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:24 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9b568828-861d-45da-abee-26006ca48832" returned: 0 in 0.286s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-quobyte-9b568828-861d-45da-abee-26006ca48832" released by "delete_volume" :: held 0.812s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Created reservations ['cc839b59-b541-4e4d-a15f-3fbc80732abb', '62a2b2ad-c5c0-4a93-b781-17bbea9597be', '7fff279a-9d86-4fc6-bd07-bb473ae27eb8', 'de2fc74c-6dd4-4517-9145-9e6b1554f4aa'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:24 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:24 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:24 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Deleted volume successfully. Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-07f28efe-f440-42ff-ae26-6b7e13e6d539 tempest-VolumesCloneTest-1753567165 None] Lock "cinder-9b568828-861d-45da-abee-26006ca48832-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8a79212b-8b2f-47e2-ac0e-361715dcd696 req-97b835ff-6375-42bc-aa67-51b4945800d3 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8a79212b-8b2f-47e2-ac0e-361715dcd696 req-97b835ff-6375-42bc-aa67-51b4945800d3 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-8a79212b-8b2f-47e2-ac0e-361715dcd696 req-97b835ff-6375-42bc-aa67-51b4945800d3 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-8a79212b-8b2f-47e2-ac0e-361715dcd696 req-97b835ff-6375-42bc-aa67-51b4945800d3 tempest-TestInstancesWithCinderVolumes-1777125652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7341f812-1c79-4fa1-8a46-3113c0358843', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:44:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-8a79212b-8b2f-47e2-ac0e-361715dcd696 req-97b835ff-6375-42bc-aa67-51b4945800d3 tempest-TestInstancesWithCinderVolumes-1777125652 None] attachment_update completed successfully. Sep 03 13:44:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-16bf1ceb-b135-4d62-b6eb-799c8e2a9b39 req-c0f060bb-28af-47bb-a07e-cd2fd88fee5c tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Terminate volume connection completed successfully. Sep 03 13:44:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-16bf1ceb-b135-4d62-b6eb-799c8e2a9b39 req-c0f060bb-28af-47bb-a07e-cd2fd88fee5c tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Deleting attachment e02cb8dd-1977-43d7-8f61-0b65aa273f1d. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "cinder-00318188-ac57-4f95-a2f1-4e06355e5493-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "cinder-00318188-ac57-4f95-a2f1-4e06355e5493-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "cinder-quobyte-00318188-ac57-4f95-a2f1-4e06355e5493" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "cinder-quobyte-00318188-ac57-4f95-a2f1-4e06355e5493" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[77095858-8b05-438f-bf24-d798d4db913e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:27 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 Sep 03 13:44:27 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:27 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493" returned: 0 in 0.412s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:28 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493 Sep 03 13:44:28 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:28 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-00318188-ac57-4f95-a2f1-4e06355e5493" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "cinder-quobyte-00318188-ac57-4f95-a2f1-4e06355e5493" released by "delete_volume" :: held 0.743s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Created reservations ['1da1f9df-9d93-4024-a8f4-1f1bdb30dbb1', '760b3c16-f1ba-44fa-a144-0529be2c746d', '14f4a6e3-7fd9-40a9-9c41-fde3db7302b3', '2970c253-23a2-45dd-9e4f-347ac0a6670e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:28 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:28 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:28 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (1fd7416a-ba80-48e1-9f33-03f5ad1e8499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dcb2cb-b4a5-44a4-b402-c344a686da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Deleted volume successfully. Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dcb2cb-b4a5-44a4-b402-c344a686da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1097967261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276e0ed3-4491-43ea-986b-7e2a5e4e2f2e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:29Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ddd456-b1b9-4dc4-84f4-82f0ec91b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ddd456-b1b9-4dc4-84f4-82f0ec91b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871d5a04-cba1-43d5-b976-6bc132dd5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871d5a04-cba1-43d5-b976-6bc132dd5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276e0ed3-4491-43ea-986b-7e2a5e4e2f2e', 'volume_name': 'volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e4be4b-6cbc-4f7f-9677-6b5088d2e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e4be4b-6cbc-4f7f-9677-6b5088d2e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb569b55-5d28-4285-9ceb-759a849aff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:28 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Volume 276e0ed3-4491-43ea-986b-7e2a5e4e2f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e', 'volume_size': 1} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1097967261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276e0ed3-4491-43ea-986b-7e2a5e4e2f2e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:29Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Creating volume 276e0ed3-4491-43ea-986b-7e2a5e4e2f2e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:28 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e 1073741824 Sep 03 13:44:28 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-16f46bd4-96eb-4d61-a677-5291c6b02bef tempest-TestServerVolumeAttachScenarioOldVersion-1923046317 None] Lock "cinder-00318188-ac57-4f95-a2f1-4e06355e5493-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:29 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e 1073741824" returned: 0 in 0.803s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:29 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e Sep 03 13:44:29 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:30 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" returned: 0 in 0.342s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb569b55-5d28-4285-9ceb-759a849aff01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b357c4-f733-45d7-8896-15d762c2db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Volume volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e (276e0ed3-4491-43ea-986b-7e2a5e4e2f2e): created successfully Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b357c4-f733-45d7-8896-15d762c2db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (1fd7416a-ba80-48e1-9f33-03f5ad1e8499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3e9402cf-4767-4377-9d66-af295e9c3224 tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:44:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-98e76105-e134-40ae-a9a2-165742379531 req-68827a4b-d528-4e2e-8917-56b87b200a91 tempest-TestInstancesWithCinderVolumes-1777125652 None] Terminate volume connection completed successfully. Sep 03 13:44:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-98e76105-e134-40ae-a9a2-165742379531 req-68827a4b-d528-4e2e-8917-56b87b200a91 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleting attachment 0afb0e0e-5596-44da-8c4d-13c250445bfc. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-bf348ec2-6347-4e96-8ade-8d32f92d9e52-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-bf348ec2-6347-4e96-8ade-8d32f92d9e52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-quobyte-bf348ec2-6347-4e96-8ade-8d32f92d9e52" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-bf348ec2-6347-4e96-8ade-8d32f92d9e52" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4946d-4ef0-423c-9f4d-65718c67329c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:31 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 Sep 03 13:44:31 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:31 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52" returned: 0 in 0.579s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:31 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52 Sep 03 13:44:31 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (da2bb21f-27c5-4dd3-a011-80a49903bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8da4ef-2409-473b-9b2a-9a835a86f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8da4ef-2409-473b-9b2a-9a835a86f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1262980310',display_name='tempest-VolumesGetTest-Volume-1504644830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca4d45c-a4e4-4e66-8f29-d8222707d28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:32Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c547ea8-7931-4eeb-a876-7b152aace3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c547ea8-7931-4eeb-a876-7b152aace3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a456e0-2a7b-4b9c-aaa9-62ed525d632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a456e0-2a7b-4b9c-aaa9-62ed525d632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca4d45c-a4e4-4e66-8f29-d8222707d28e', 'volume_name': 'volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8459141-e444-42ad-8375-d24ca83e9b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8459141-e444-42ad-8375-d24ca83e9b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8962c16-7e82-463c-b2d1-e8c103d32f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Volume 5ca4d45c-a4e4-4e66-8f29-d8222707d28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e', 'volume_size': 1} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1262980310',display_name='tempest-VolumesGetTest-Volume-1504644830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca4d45c-a4e4-4e66-8f29-d8222707d28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:32Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Creating volume 5ca4d45c-a4e4-4e66-8f29-d8222707d28e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:31 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:31 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e 1073741824 Sep 03 13:44:31 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:32 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf348ec2-6347-4e96-8ade-8d32f92d9e52" returned: 0 in 0.277s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-bf348ec2-6347-4e96-8ade-8d32f92d9e52" released by "delete_volume" :: held 0.903s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:32 devstack cinder-volume[86933]: WARNING cinder.quota [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455296671-993128228 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455296671-993128228, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:32 devstack cinder-volume[86933]: WARNING cinder.quota [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455296671-993128228 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455296671-993128228, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Created reservations ['81f0930a-4fab-4b46-b29c-c348bc680971', '1145a60a-7ab8-49be-aa42-486ee0f3f167', 'bb967208-1412-407b-80e5-d6e7c386b258', 'b69236b5-ff14-4dbc-b2b1-6ed702d54ccd'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:32 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:32 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:32 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e 1073741824" returned: 0 in 0.459s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:32 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:32 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e Sep 03 13:44:32 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleted volume successfully. Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-06482b7f-7c6c-4c67-84c0-047093c6b934 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-bf348ec2-6347-4e96-8ade-8d32f92d9e52-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:32 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8962c16-7e82-463c-b2d1-e8c103d32f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3432f830-ec24-40f3-962e-678d0a5e864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:32 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Volume volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e (5ca4d45c-a4e4-4e66-8f29-d8222707d28e): created successfully Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3432f830-ec24-40f3-962e-678d0a5e864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (da2bb21f-27c5-4dd3-a011-80a49903bda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5a77e52e-4486-468d-ab45-531b7f9b30c2 tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:33 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:33 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:33 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:44:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-5ca4d45c-a4e4-4e66-8f29-d8222707d28e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "cinder-5ca4d45c-a4e4-4e66-8f29-d8222707d28e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d255a405-b772-42bd-bf4c-504663641d51]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:34 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e Sep 03 13:44:34 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:34 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:34 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e Sep 03 13:44:34 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:34 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-5ca4d45c-a4e4-4e66-8f29-d8222707d28e" released by "delete_volume" :: held 0.803s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:34 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Created reservations ['b4a762e7-be35-4e59-8271-c47b0ddd3550', '5eefe1a8-c108-42f6-a097-55de921e93b5', '8312969d-9973-4d5e-974b-6350fc225940', '94ec8f5a-eef5-4207-82a8-a9746ff48ca3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:35 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:35 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-59060119-b3c4-4ce2-90cc-135b0e73c1b2 req-dbed2567-2c8d-4a58-b62d-ee193972a59e tempest-TestInstancesWithCinderVolumes-1777125652 None] Terminate volume connection completed successfully. Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-59060119-b3c4-4ce2-90cc-135b0e73c1b2 req-dbed2567-2c8d-4a58-b62d-ee193972a59e tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleting attachment 7341f812-1c79-4fa1-8a46-3113c0358843. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:35 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "cinder-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1825186b-c19d-4744-880d-fdede97d4409 tempest-VolumesGetTest-1902393302 None] Lock "cinder-5ca4d45c-a4e4-4e66-8f29-d8222707d28e-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bac225-101d-46e1-86ff-519988b81ad7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:35 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e Sep 03 13:44:35 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-dd5d16d0-720d-4448-b3d8-4a65e4061f76-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-dd5d16d0-720d-4448-b3d8-4a65e4061f76-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:35 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" returned: 0 in 0.427s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:35 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e Sep 03 13:44:35 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-quobyte-dd5d16d0-720d-4448-b3d8-4a65e4061f76" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-dd5d16d0-720d-4448-b3d8-4a65e4061f76" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15afc9aa-b341-4ba7-8776-3064eab891ce]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:36 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 Sep 03 13:44:36 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:36 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" returned: 0 in 0.338s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e" released by "delete_volume" :: held 0.824s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Created reservations ['622c58b5-6a24-4431-aecc-2c69f44f4c0f', '3a8ab4bc-118c-4ea1-9fe7-1659ab43734f', '938b3903-9ae0-493d-96ac-16827c515751', 'f3bc41ec-1ed5-448a-96c4-0f8cbc0df69d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76" returned: 0 in 0.479s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:36 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:36 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:36 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:36 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76 Sep 03 13:44:36 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:36 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dd5d16d0-720d-4448-b3d8-4a65e4061f76" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:36 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-dd5d16d0-720d-4448-b3d8-4a65e4061f76" released by "delete_volume" :: held 0.905s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-27186583-175e-433a-b436-0b5b843ae04b tempest-VolumesGetTest-1902393302 None] Lock "cinder-276e0ed3-4491-43ea-986b-7e2a5e4e2f2e-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:36 devstack cinder-volume[86933]: WARNING cinder.quota [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1385093330-819190462 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1385093330-819190462, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:36 devstack cinder-volume[86933]: WARNING cinder.quota [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1385093330-819190462 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1385093330-819190462, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Created reservations ['8068e243-61fe-4889-ab20-cbfcb1a617ac', 'e2196416-28ca-4f43-9710-8a9d17c75fd5', '55cacd7b-cab1-4d3c-aedc-734ec22a33ae', '1b4ca21b-9afd-4176-b363-d9981640da2d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:37 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:37 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (f52e1302-9a42-4269-b18c-b367ad56d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb354155-adb0-4ada-bfc2-008d77378c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb354155-adb0-4ada-bfc2-008d77378c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-721818565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467e8706-987d-4af5-991d-e399608dfb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:37Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b5e0e-93e4-4c10-9765-de854a366a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b5e0e-93e4-4c10-9765-de854a366a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d94d4f-d313-4607-8b9c-f221e2fc1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d94d4f-d313-4607-8b9c-f221e2fc1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467e8706-987d-4af5-991d-e399608dfb75', 'volume_name': 'volume-467e8706-987d-4af5-991d-e399608dfb75', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:37 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0753c63-bc7a-4b5d-b579-2672b8315ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0753c63-bc7a-4b5d-b579-2672b8315ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b68c641-1a19-4a1b-8f50-3d65dbcca9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:37 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Volume 467e8706-987d-4af5-991d-e399608dfb75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467e8706-987d-4af5-991d-e399608dfb75', 'volume_size': 1} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-721818565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467e8706-987d-4af5-991d-e399608dfb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:37Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Creating volume 467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:37 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.328s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleted volume successfully. Sep 03 13:44:37 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 1073741824 Sep 03 13:44:37 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-59cf6dda-a3e6-48e5-9d42-0f620b834569 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-dd5d16d0-720d-4448-b3d8-4a65e4061f76-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:37 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 1073741824" returned: 0 in 0.522s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:37 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:44:37 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:38 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.339s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b68c641-1a19-4a1b-8f50-3d65dbcca9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467e8706-987d-4af5-991d-e399608dfb75', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4499cd4d-d12f-4add-8b6c-c5ce88d75211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:38 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Volume volume-467e8706-987d-4af5-991d-e399608dfb75 (467e8706-987d-4af5-991d-e399608dfb75): created successfully Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4499cd4d-d12f-4add-8b6c-c5ce88d75211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (f52e1302-9a42-4269-b18c-b367ad56d81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:38 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a2adfc31-1b48-47d1-8dc5-35174e086c9e tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (530f3d61-cb45-4cab-a479-37d3f968a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b813cf2-3f90-43a2-922a-231b997489db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b813cf2-3f90-43a2-922a-231b997489db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1074395260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0006b7-2a5a-41cf-ae7e-8d221ddc2439,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=467e8706-987d-4af5-991d-e399608dfb75,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:40Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53859708-721c-4e01-ae33-c873c11419c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53859708-721c-4e01-ae33-c873c11419c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019542bd-b1a0-4448-9915-f1991281eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019542bd-b1a0-4448-9915-f1991281eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0b0006b7-2a5a-41cf-ae7e-8d221ddc2439', 'volume_name': 'volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439', 'volume_size': 1, 'source_volid': '467e8706-987d-4af5-991d-e399608dfb75', 'source_volstatus': 'available'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5750493c-b034-48a3-818c-1e6c3e74b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5750493c-b034-48a3-818c-1e6c3e74b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1124ef-783c-4e61-84fa-ed9c50d3764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Volume 0b0006b7-2a5a-41cf-ae7e-8d221ddc2439: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439', 'volume_size': 1, 'source_volid': '467e8706-987d-4af5-991d-e399608dfb75', 'source_volstatus': 'available'} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:40 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Cloning volume 467e8706-987d-4af5-991d-e399608dfb75 to volume 0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Creating offline snapshot 64df11f7-6948-4868-898b-f559b872d9c4 of volume 467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef130122-66f1-41b8-a0a7-2c509175728b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:40 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:44:40 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:40 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:40 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 1G Sep 03 13:44:40 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-22f5494f-eca3-409b-984b-eebe9073047f req-7eeb95c2-1376-485a-9e32-f97a3f9fedce tempest-TestInstancesWithCinderVolumes-1777125652 None] Terminate volume connection completed successfully. Sep 03 13:44:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-22f5494f-eca3-409b-984b-eebe9073047f req-7eeb95c2-1376-485a-9e32-f97a3f9fedce tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleting attachment 8ae505a8-5d38-4698-8827-3ee8debf93d8. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:44:41 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 1G" returned: 0 in 0.545s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467e8706-987d-4af5-991d-e399608dfb75 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:41 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467e8706-987d-4af5-991d-e399608dfb75 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:41 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:41 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467e8706-987d-4af5-991d-e399608dfb75 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.376s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:41 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 is being set with open permissions: ugo+rw Sep 03 13:44:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:41 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:41 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:42 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:42 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info Sep 03 13:44:42 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "cinder-quobyte-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:42 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:42 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info is being set with open permissions: ugo+rw Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c702682-b6af-4fb4-a9e8-fbf464322b24]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:42 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info Sep 03 13:44:42 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:42 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 Sep 03 13:44:42 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:42 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.info" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] snapshot: 64df11f7-6948-4868-898b-f559b872d9c4, volume: 0b0006b7-2a5a-41cf-ae7e-8d221ddc2439, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2f76f-b554-49fe-a037-2e94451bf8c7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:42 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:42 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268 Sep 03 13:44:42 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:42 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:42 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:43 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" returned: 0 in 0.259s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-quobyte-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268" released by "delete_volume" :: held 0.730s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:43 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-467e8706-987d-4af5-991d-e399608dfb75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd822a0-4c61-4a18-8f2c-1707a768c157]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:43 devstack cinder-volume[86933]: WARNING cinder.quota [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1509709329-1911438639 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1509709329-1911438639, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:43 devstack cinder-volume[86933]: WARNING cinder.quota [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1509709329-1911438639 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1509709329-1911438639, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Created reservations ['0d100c6e-e83b-4e47-a6ae-60f7bddf9762', '283d165a-0b7d-4539-8669-d00bcea487f3', '2edc1e2a-0094-450f-b39a-61f265484b5d', 'f8e3885a-865e-4deb-95f7-6cf4a8950e21'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:43 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:44:43 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:43 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:43 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:43 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.277s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:43 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Deleted volume successfully. Sep 03 13:44:43 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 Sep 03 13:44:43 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5386b3bc-cbe9-414a-ad71-c87a82a53c38 tempest-TestInstancesWithCinderVolumes-1777125652 None] Lock "cinder-a0c9aa60-c737-4b4b-a3ed-c4bf0a19c268-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:49 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" returned: 0 in 5.726s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:44:49 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Converted 1024.00 MB image at 178.79 MB/s Sep 03 13:44:49 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 is being set with open permissions: ugo+rw Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:49 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 Sep 03 13:44:49 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:49 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" released by "_copy_volume_from_snapshot" :: held 6.848s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-64df11f7-6948-4868-898b-f559b872d9c4" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-64df11f7-6948-4868-898b-f559b872d9c4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Deleting offline snapshot 64df11f7-6948-4868-898b-f559b872d9c4 of volume 467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] snapshot_file for this snap is: volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d371eb-2b8f-4dd1-8cc4-af2b40b9d454]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:49 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:49 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:50 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-467e8706-987d-4af5-991d-e399608dfb75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9dd184-7139-4e58-8f02-98ebf3dea3ed]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:50 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:44:50 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:50 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.612s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:50 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:50 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Flow 'volume_create_manager' (2b555cfe-0549-42ea-85bc-01cce81c55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e718558-0a68-4f38-bc22-6bcd589c04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e718558-0a68-4f38-bc22-6bcd589c04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1533479018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e5166-094d-498c-8865-beadc67d4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089f5fe6ecb74697967a65a57ed0b778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:51Z,use_quota=True,user_id='253ef940d2de436196eee6d616a28f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb47fea4-0876-4917-843d-df4b78acbeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb47fea4-0876-4917-843d-df4b78acbeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec0df16-47ef-400e-9139-3561e92ebf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec0df16-47ef-400e-9139-3561e92ebf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9e5166-094d-498c-8865-beadc67d4355', 'volume_name': 'volume-9a9e5166-094d-498c-8865-beadc67d4355', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b25a41-3313-44d8-b2ef-2bc8a1e01dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b25a41-3313-44d8-b2ef-2bc8a1e01dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923dae8-d390-476c-b6b2-3a6df21dfefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Volume 9a9e5166-094d-498c-8865-beadc67d4355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9e5166-094d-498c-8865-beadc67d4355', 'volume_size': 1} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:50 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.324s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:51 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4 Sep 03 13:44:51 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:51 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75.64df11f7-6948-4868-898b-f559b872d9c4" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-64df11f7-6948-4868-898b-f559b872d9c4" released by "_delete_snapshot" :: held 1.751s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1533479018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e5166-094d-498c-8865-beadc67d4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089f5fe6ecb74697967a65a57ed0b778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:51Z,use_quota=True,user_id='253ef940d2de436196eee6d616a28f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Creating volume 9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:51 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:51 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 1073741824 Sep 03 13:44:51 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1124ef-783c-4e61-84fa-ed9c50d3764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439', 'volume_size': 1, 'source_volid': '467e8706-987d-4af5-991d-e399608dfb75', 'source_volstatus': 'available'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b905d6-06b4-407d-a5ef-a44f534317a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Volume volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 (0b0006b7-2a5a-41cf-ae7e-8d221ddc2439): created successfully Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b905d6-06b4-407d-a5ef-a44f534317a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (530f3d61-cb45-4cab-a479-37d3f968a154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-52dbf2ca-a69a-417a-9baa-adb4f8210b8d tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:44:51 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 1073741824" returned: 0 in 0.472s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:51 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:44:51 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:52 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.287s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923dae8-d390-476c-b6b2-3a6df21dfefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9e5166-094d-498c-8865-beadc67d4355', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcfd191-67aa-48c4-bdaf-3808cfae83a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:52 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Volume volume-9a9e5166-094d-498c-8865-beadc67d4355 (9a9e5166-094d-498c-8865-beadc67d4355): created successfully Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcfd191-67aa-48c4-bdaf-3808cfae83a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Flow 'volume_create_manager' (2b555cfe-0549-42ea-85bc-01cce81c55b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0930e4cb-c641-4a2e-8646-1854c02fb620 tempest-VolumeDependencyTests-1978816781 None] Created volume successfully. Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Creating offline snapshot 19d70a13-6b61-494f-b544-58c44d115852 of volume 9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e182702d-cc30-4e54-8a99-6f79231c6b72]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (c59ffc76-a138-49b5-8918-bf8144228344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11aabdb-e462-468b-8e96-f358cbd1c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11aabdb-e462-468b-8e96-f358cbd1c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1060210539',display_name='tempest-VolumesGetTest-Volume-971346319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd95284-2b5c-4bab-94ad-c57c9fcfbaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:53Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f9f1ad-e0b6-4b7d-8823-6118445d0ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f9f1ad-e0b6-4b7d-8823-6118445d0ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b36be4-f594-4143-9961-75d2130123ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b36be4-f594-4143-9961-75d2130123ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd95284-2b5c-4bab-94ad-c57c9fcfbaed', 'volume_name': 'volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda4612-9590-4126-847d-c6fbd34dec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda4612-9590-4126-847d-c6fbd34dec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1495ea2c-4ea2-4f27-8fcc-37fb19f280a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:53 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Volume bfd95284-2b5c-4bab-94ad-c57c9fcfbaed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed', 'volume_size': 1} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:53 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:44:53 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:53 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.377s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:53 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 1G Sep 03 13:44:53 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:54 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 1G" returned: 0 in 0.446s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9e5166-094d-498c-8865-beadc67d4355 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:54 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9e5166-094d-498c-8865-beadc67d4355 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:44:54 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:54 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9e5166-094d-498c-8865-beadc67d4355 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:54 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 is being set with open permissions: ugo+rw Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:54 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:44:54 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:54 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.238s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:54 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info Sep 03 13:44:54 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:55 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:55 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info is being set with open permissions: ugo+rw Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:55 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info Sep 03 13:44:55 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:55 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.info" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1060210539',display_name='tempest-VolumesGetTest-Volume-971346319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd95284-2b5c-4bab-94ad-c57c9fcfbaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:53Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Creating volume bfd95284-2b5c-4bab-94ad-c57c9fcfbaed {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:55 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=99,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=12 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:44:55 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed 1073741824 Sep 03 13:44:55 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=114,cinder:UPDATE=124,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:44:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cbb5899d-0d21-4dc6-afd9-c3a8c0c12665 tempest-VolumeDependencyTests-1978816781 None] Create snapshot completed successfully Sep 03 13:44:55 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed 1073741824" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:55 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed Sep 03 13:44:55 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:56 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" returned: 0 in 0.278s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1495ea2c-4ea2-4f27-8fcc-37fb19f280a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6df9f4b-8722-4587-bcfd-fd26882fbb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:56 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Volume volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed (bfd95284-2b5c-4bab-94ad-c57c9fcfbaed): created successfully Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6df9f4b-8722-4587-bcfd-fd26882fbb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (c59ffc76-a138-49b5-8918-bf8144228344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8a90dbc4-0e94-4ff0-9d26-4480ab0d7e55 tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "cinder-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0cb17a-ab39-4bac-896b-be452880fb2c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:56 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed Sep 03 13:44:56 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Flow 'volume_create_manager' (94f9d612-8333-418f-bd5a-7129269f157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:44:56 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c670ca-7e01-4d9f-bad2-247ef8a04fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c670ca-7e01-4d9f-bad2-247ef8a04fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1212954658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca49956b-b745-4471-a604-e1bfeebbc867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089f5fe6ecb74697967a65a57ed0b778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19d70a13-6b61-494f-b544-58c44d115852,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:44:57Z,use_quota=True,user_id='253ef940d2de436196eee6d616a28f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3fedb3-6d71-4a40-b54c-cae3e740fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3fedb3-6d71-4a40-b54c-cae3e740fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f59a587-439b-4af8-8d0b-5f19d8d3838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f59a587-439b-4af8-8d0b-5f19d8d3838c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca49956b-b745-4471-a604-e1bfeebbc867', 'volume_name': 'volume-ca49956b-b745-4471-a604-e1bfeebbc867', 'volume_size': 1, 'snapshot_id': '19d70a13-6b61-494f-b544-58c44d115852'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18359924-acb7-4c19-9a01-3b42acfb9b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18359924-acb7-4c19-9a01-3b42acfb9b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:44:57 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00fe28e-fa52-4aa1-b96f-167a02cf081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:44:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Volume ca49956b-b745-4471-a604-e1bfeebbc867: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca49956b-b745-4471-a604-e1bfeebbc867', 'volume_size': 1, 'snapshot_id': '19d70a13-6b61-494f-b544-58c44d115852'} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852-ca49956b-b745-4471-a604-e1bfeebbc867" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:57 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed Sep 03 13:44:57 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852-ca49956b-b745-4471-a604-e1bfeebbc867" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Creating volume ca49956b-b745-4471-a604-e1bfeebbc867 from snapshot 19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] snapshot: 19d70a13-6b61-494f-b544-58c44d115852, volume: ca49956b-b745-4471-a604-e1bfeebbc867, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bcc8b4-cc03-4c89-9ded-825813539413]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:57 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:44:57 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:57 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed" released by "delete_volume" :: held 0.789s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Created reservations ['b16bf237-eb84-4743-8225-73a477c0a832', 'ac902f9c-69ea-41d8-a882-bdbb5dbf3c7e', 'fd9de806-ad1d-421c-a758-35ababcbd9ee', '0ece3ff1-ae72-4ce8-aae3-2c23a2ce9190'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:57 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:57 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:57 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9e5166-094d-498c-8865-beadc67d4355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb95ba-4ed5-4a39-b072-8eace03845f8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:57 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:44:57 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "cinder-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:57 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.365s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec9657-7efb-4cf9-8b28-e5ebd38a031b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-76241e72-6d94-40a4-9031-e271f07367b1 tempest-VolumesGetTest-1902393302 None] Lock "cinder-bfd95284-2b5c-4bab-94ad-c57c9fcfbaed-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:58 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 Sep 03 13:44:58 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:58 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.504s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:58 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 Sep 03 13:44:58 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:58 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" returned: 0 in 0.412s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:58 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439 Sep 03 13:44:58 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:58 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" returned: 0 in 0.272s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439" released by "delete_volume" :: held 0.743s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Created reservations ['c52de9e4-6610-476c-aabd-97f01eed0f87', '49729233-0d74-479f-86e4-453129dbac49', 'c6d8880a-66f1-40a6-b9e3-aef4b1fdc1b7', 'ce2bafc5-7967-4d75-b6db-26289c7582b5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:44:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:59 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:44:59 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-467e8706-987d-4af5-991d-e399608dfb75-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "cinder-467e8706-987d-4af5-991d-e399608dfb75-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-467e8706-987d-4af5-991d-e399608dfb75" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-467e8706-987d-4af5-991d-e399608dfb75" acquired by "delete_volume" :: waited 0.045s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[858381bc-12e7-4bf5-83c5-19bc990b5804]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:44:59 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.930s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:44:59 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:44:59 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:45:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f07f630-2470-4f13-b211-79a07e50d74a tempest-VolumesGetTest-1902393302 None] Lock "cinder-0b0006b7-2a5a-41cf-ae7e-8d221ddc2439-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:00 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:45:00 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:00 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.823s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:00 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75 Sep 03 13:45:00 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:01 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-467e8706-987d-4af5-991d-e399608dfb75" returned: 0 in 0.696s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-467e8706-987d-4af5-991d-e399608dfb75" released by "delete_volume" :: held 1.680s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Created reservations ['eaeead6c-04f2-4b3f-8963-eb67dd66bd6f', '71ad4859-9c9c-4607-8528-9dfe57eddc17', '495726fb-89e7-4683-9e86-4a9564848b45', '963910f3-a3bb-42f7-afb6-aeede50004f0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:01 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:01 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:02 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.478s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:02 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:45:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-258531ab-2cfe-4578-83e8-500185766633 tempest-VolumesGetTest-1902393302 None] Lock "cinder-467e8706-987d-4af5-991d-e399608dfb75-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (dd243437-66e5-4590-aea8-dcf18cf8f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:03 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a7109d-553b-4ccf-9c77-6f4472e76152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867" returned: 0 in 5.738s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:45:03 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Converted 1024.00 MB image at 178.41 MB/s Sep 03 13:45:03 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 is being set with open permissions: ugo+rw Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a7109d-553b-4ccf-9c77-6f4472e76152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500184070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a881ea-d4db-4e5c-a7de-be20f4b42d53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:04Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:03 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 Sep 03 13:45:03 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a3be42-2a54-42e5-8cbc-9028defd5485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a3be42-2a54-42e5-8cbc-9028defd5485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d29d8-ef77-436a-893d-cf53811007ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:03 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:45:04 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" released by "_copy_volume_from_snapshot" :: held 7.003s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d29d8-ef77-436a-893d-cf53811007ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4a881ea-d4db-4e5c-a7de-be20f4b42d53', 'volume_name': 'volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdf83d5-0158-4dff-a145-95ecd3d0c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdf83d5-0158-4dff-a145-95ecd3d0c539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077a0dd1-adfb-4563-9789-ada40c50e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Trying to clone f4a881ea-d4db-4e5c-a7de-be20f4b42d53 from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852-ca49956b-b745-4471-a604-e1bfeebbc867" released by "_create_volume_from_snapshot" :: held 7.123s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.145s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00fe28e-fa52-4aa1-b96f-167a02cf081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca49956b-b745-4471-a604-e1bfeebbc867', 'volume_size': 1, 'snapshot_id': '19d70a13-6b61-494f-b544-58c44d115852'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa20917f-5b08-4f2b-98a4-b619077f3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Volume volume-ca49956b-b745-4471-a604-e1bfeebbc867 (ca49956b-b745-4471-a604-e1bfeebbc867): created successfully Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa20917f-5b08-4f2b-98a4-b619077f3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Flow 'volume_create_manager' (94f9d612-8333-418f-bd5a-7129269f157c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-555a4163-bd72-4405-a2fa-05b334b13d44 tempest-VolumeDependencyTests-1978816781 None] Created volume successfully. Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:45:04 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Image download 20.69 MB at 20.69 MB/s Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[40572aed-4c3e-4f07-9a87-b72fed5419fc]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:04 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD Sep 03 13:45:04 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:04 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-19d70a13-6b61-494f-b544-58c44d115852-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:04 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 is fetched for user a0c6723528134542a8b105b753a80d58. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-19d70a13-6b61-494f-b544-58c44d115852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7d5a4d-f3df-4a48-8ac4-2b8ee5c3026d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Deleting offline snapshot 19d70a13-6b61-494f-b544-58c44d115852 of volume 9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] snapshot_file for this snap is: volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c243c-2edf-4e9d-9817-b9a7fcf7b6c9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:05 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD Sep 03 13:45:05 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:05 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:45:05 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:05 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500184070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a881ea-d4db-4e5c-a7de-be20f4b42d53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:04Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Creating volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:05 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:05 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1073741824 Sep 03 13:45:05 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:05 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.390s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9e5166-094d-498c-8865-beadc67d4355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[848f6fd1-2638-4619-87e6-0724dc5c900c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:05 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:45:05 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:05 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1073741824" returned: 0 in 0.520s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:06 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 Sep 03 13:45:06 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:06 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.602s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:06 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:45:06 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:06 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" returned: 0 in 0.308s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Attempting download of 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13a581-1686-4fa6-b800-acbefe0ea5cc]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:06 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp Sep 03 13:45:06 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Flow 'volume_create_manager' (dc45f567-1dc9-4b8d-b38a-a5ce094e608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a29be-bb42-43b7-a98b-b9c660de6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:06 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a29be-bb42-43b7-a98b-b9c660de6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62457cd-09d7-4984-988a-906eba6b8a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbed8331118466e9a8a59e525242ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:06Z,use_quota=True,user_id='6ce9cfec57624ab399d49d86a8fbc9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236bbc72-8a68-4914-860d-30be8bd447b4),volume_type_id=236bbc72-8a68-4914-860d-30be8bd447b4)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:06 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852 Sep 03 13:45:06 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e21b7-9ac1-4441-94b0-2ff1c9a6b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e21b7-9ac1-4441-94b0-2ff1c9a6b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e2d8b6-b9c6-4e0c-808d-02bb8db17cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:45:06 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp" returned: 0 in 0.361s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:06 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355.19d70a13-6b61-494f-b544-58c44d115852" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e2d8b6-b9c6-4e0c-808d-02bb8db17cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f62457cd-09d7-4984-988a-906eba6b8a9f', 'volume_name': 'volume-f62457cd-09d7-4984-988a-906eba6b8a9f', 'volume_size': 1, 'image_id': '1efc68ec-4907-4398-9687-cf45a777db39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7cfb6c434496fef0a15d22a7b4c7ed8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dbed8331118466e9a8a59e525242ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ce47e4e3e200a8ec88e659857c769c13cf342ca120a17a4d70669317265c7089b6180b8b551396b84c55f9104e7c8d2d065ba96bac30b8704bb8472019d68d5', 'id': '1efc68ec-4907-4398-9687-cf45a777db39', 'created_at': datetime.datetime(2026, 9, 3, 11, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1efc68ec-4907-4398-9687-cf45a777db39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8741702a-374d-4d6d-9cca-99d5fb7c3072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8741702a-374d-4d6d-9cca-99d5fb7c3072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da055c8-f801-4906-8187-41b7576794d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Volume f62457cd-09d7-4984-988a-906eba6b8a9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f62457cd-09d7-4984-988a-906eba6b8a9f', 'volume_size': 1, 'image_id': '1efc68ec-4907-4398-9687-cf45a777db39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7cfb6c434496fef0a15d22a7b4c7ed8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dbed8331118466e9a8a59e525242ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ce47e4e3e200a8ec88e659857c769c13cf342ca120a17a4d70669317265c7089b6180b8b551396b84c55f9104e7c8d2d065ba96bac30b8704bb8472019d68d5', 'id': '1efc68ec-4907-4398-9687-cf45a777db39', 'created_at': datetime.datetime(2026, 9, 3, 11, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1efc68ec-4907-4398-9687-cf45a777db39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Trying to clone f62457cd-09d7-4984-988a-906eba6b8a9f from image 1efc68ec-4907-4398-9687-cf45a777db39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-19d70a13-6b61-494f-b544-58c44d115852" released by "_delete_snapshot" :: held 1.795s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" released by "delete_snapshot" :: held 1.835s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:06 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp Sep 03 13:45:06 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:45:06 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Image download 0.00 MB at 0.00 MB/s Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Created reservations ['78797378-c248-4100-a406-8b7f16085c9b', '31c56a32-9a90-4e21-aec3-584b7381f0c8', '0da64652-3070-4046-be25-42e4c9f0fa96', '9f8abd73-5418-48e6-a907-c943ff662972'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fb037-0941-4ca9-a784-7aa4752c58b2]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Delete snapshot completed successfully. Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b832a114-11f4-4a63-be2f-4315dcd4cc26 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-19d70a13-6b61-494f-b544-58c44d115852-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:07 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:07 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-9a9e5166-094d-498c-8865-beadc67d4355-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-9a9e5166-094d-498c-8865-beadc67d4355-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:07 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp" returned: 1 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_eio1etgp' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83d7680-aab1-4257-8d9c-5a2447e4eb89]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[317c63ae-260c-48d8-9b1e-ab0f3f80c2e9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD Sep 03 13:45:07 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:45:07 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:07 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 was qcow2, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 Sep 03 13:45:07 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355 Sep 03 13:45:07 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:07 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Temporary image 1efc68ec-4907-4398-9687-cf45a777db39 is fetched for user 6ce9cfec57624ab399d49d86a8fbc9a1. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab775f9-82e9-41b6-926e-13c6558a341a]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:07 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9a9e5166-094d-498c-8865-beadc67d4355" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-9a9e5166-094d-498c-8865-beadc67d4355" released by "delete_volume" :: held 0.727s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:07 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:07 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Created reservations ['cd815222-35a6-42f7-b0c7-2ff91accda2e', '75526737-3886-4589-af93-88db75e3fdff', 'c128b142-1884-4e7a-a9bb-2918a248ae67', '1734414c-259a-43ce-be6f-09f4e2a206ee'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:08 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:08 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:08 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-ca49956b-b745-4471-a604-e1bfeebbc867-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-ca49956b-b745-4471-a604-e1bfeebbc867-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:08 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:08 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:08 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Deleted volume successfully. Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0eb352-a618-4ca2-b97c-f715fc462f89]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a0e0c949-f594-407e-b9dd-267f14265cca tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-9a9e5166-094d-498c-8865-beadc67d4355-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:08 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 1 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62457cd-09d7-4984-988a-906eba6b8a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbed8331118466e9a8a59e525242ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:06Z,use_quota=True,user_id='6ce9cfec57624ab399d49d86a8fbc9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236bbc72-8a68-4914-860d-30be8bd447b4),volume_type_id=236bbc72-8a68-4914-860d-30be8bd447b4)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Creating volume f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:08 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 Sep 03 13:45:08 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:08 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:08 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1073741824 Sep 03 13:45:08 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867" returned: 0 in 0.523s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:09 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867 Sep 03 13:45:09 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1073741824" returned: 0 in 0.496s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:09 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f Sep 03 13:45:09 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ca49956b-b745-4471-a604-e1bfeebbc867" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-quobyte-ca49956b-b745-4471-a604-e1bfeebbc867" released by "delete_volume" :: held 0.863s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Created reservations ['f41b209e-1bf8-40f4-be91-d09ddd1c7761', 'b0d568a1-2427-4e6c-8fc4-5479a2276faf', '45010a5d-ac4e-4090-9c52-65b6387b45b8', 'b0eb7e68-f587-43e8-847f-c40ceea7a1b7'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:09 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" returned: 0 in 1.920s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4b06dc-33f1-463b-a058-dba2e7cf16d8_y63ryulrdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:45:09 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Converted 112.00 MB image at 58.28 MB/s Sep 03 13:45:09 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:09 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:09 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1G Sep 03 13:45:09 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f" returned: 0 in 0.301s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Attempting download of 1efc68ec-4907-4398-9687-cf45a777db39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}])) to volume f62457cd-09d7-4984-988a-906eba6b8a9f. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce12c769-214b-4669-80e3-0b002bd1bb75]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:09 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.289s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Deleted volume successfully. Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-33e61270-9161-429f-be0c-6998c8ed8341 tempest-VolumeDependencyTests-1978816781 None] Lock "cinder-ca49956b-b745-4471-a604-e1bfeebbc867-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:09 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v Sep 03 13:45:09 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:09 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 1G" returned: 0 in 0.447s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Downloaded image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}])) to volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Temporary image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 for user a0c6723528134542a8b105b753a80d58 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Marking volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Copying metadata from image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 to f4a881ea-d4db-4e5c-a7de-be20f4b42d53. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:45:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Creating volume glance metadata for volume f4a881ea-d4db-4e5c-a7de-be20f4b42d53 backed by image 8c4b06dc-33f1-463b-a058-dba2e7cf16d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:45:10 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077a0dd1-adfb-4563-9789-ada40c50e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53', 'volume_size': 1, 'image_id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41a2fec168f94ecfb978f0b16bdd96fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c4b06dc-33f1-463b-a058-dba2e7cf16d8', 'created_at': datetime.datetime(2026, 9, 3, 11, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4b06dc-33f1-463b-a058-dba2e7cf16d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d1691-153b-4e6d-9855-b37ebe8bfd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Volume volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 (f4a881ea-d4db-4e5c-a7de-be20f4b42d53): created successfully Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d1691-153b-4e6d-9855-b37ebe8bfd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (dd243437-66e5-4590-aea8-dcf18cf8f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-401211c0-5fe2-44e8-9cca-f3dd9483d86c tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:45:10 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v Sep 03 13:45:10 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:10 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v" returned: 1 in 0.337s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1efc68ec-4907-4398-9687-cf45a777db39_xv0lk51v' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf5e185-7697-4054-82fe-7827c5fa771d]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:10 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:10 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:10 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:10 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD Sep 03 13:45:10 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:11 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] 1efc68ec-4907-4398-9687-cf45a777db39 was raw, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:11 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f Sep 03 13:45:11 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:11 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f" returned: 0 in 0.572s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1efc68ec-4907-4398-9687-cf45a777db39_rb41afp9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:45:11 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 13:45:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:11 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1G Sep 03 13:45:11 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:12 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f 1G" returned: 0 in 0.398s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Downloaded image 1efc68ec-4907-4398-9687-cf45a777db39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}])) to volume f62457cd-09d7-4984-988a-906eba6b8a9f successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Temporary image 1efc68ec-4907-4398-9687-cf45a777db39 for user 6ce9cfec57624ab399d49d86a8fbc9a1 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Marking volume f62457cd-09d7-4984-988a-906eba6b8a9f as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Copying metadata from image 1efc68ec-4907-4398-9687-cf45a777db39 to f62457cd-09d7-4984-988a-906eba6b8a9f. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Creating volume glance metadata for volume f62457cd-09d7-4984-988a-906eba6b8a9f backed by image 1efc68ec-4907-4398-9687-cf45a777db39 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1efc68ec-4907-4398-9687-cf45a777db39', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd7cfb6c434496fef0a15d22a7b4c7ed8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (44bf2109-4c85-4918-b883-2f8cf5e8c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a96d9e-81ce-4fc9-a1ba-adb25fdc6cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a96d9e-81ce-4fc9-a1ba-adb25fdc6cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1628809296',display_name='tempest-VolumesGetTest-Volume-1749852523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3c9753-235d-4504-9c3d-f4f3f2c4d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:12Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008127e2-deaf-4008-b71e-47f2bb0c63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008127e2-deaf-4008-b71e-47f2bb0c63b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206525cc-f732-4e06-8f4c-4855c496be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206525cc-f732-4e06-8f4c-4855c496be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3c9753-235d-4504-9c3d-f4f3f2c4d31d', 'volume_name': 'volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcc433c-a2cd-49af-8a76-5357e98ad5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcc433c-a2cd-49af-8a76-5357e98ad5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a740fe12-4e8c-4179-9cc2-2ca3f27d3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Volume bb3c9753-235d-4504-9c3d-f4f3f2c4d31d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d', 'volume_size': 1} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1628809296',display_name='tempest-VolumesGetTest-Volume-1749852523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3c9753-235d-4504-9c3d-f4f3f2c4d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b39fdebfd04e4097bc605839d3f0fc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:12Z,use_quota=True,user_id='a0c6723528134542a8b105b753a80d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Creating volume bb3c9753-235d-4504-9c3d-f4f3f2c4d31d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:12 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:12 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d 1073741824 Sep 03 13:45:12 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da055c8-f801-4906-8187-41b7576794d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62457cd-09d7-4984-988a-906eba6b8a9f', 'volume_size': 1, 'image_id': '1efc68ec-4907-4398-9687-cf45a777db39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1efc68ec-4907-4398-9687-cf45a777db39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7cfb6c434496fef0a15d22a7b4c7ed8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dbed8331118466e9a8a59e525242ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ce47e4e3e200a8ec88e659857c769c13cf342ca120a17a4d70669317265c7089b6180b8b551396b84c55f9104e7c8d2d065ba96bac30b8704bb8472019d68d5', 'id': '1efc68ec-4907-4398-9687-cf45a777db39', 'created_at': datetime.datetime(2026, 9, 3, 11, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1efc68ec-4907-4398-9687-cf45a777db39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06f7b2-6b1f-4744-97d3-97bdad77119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Volume volume-f62457cd-09d7-4984-988a-906eba6b8a9f (f62457cd-09d7-4984-988a-906eba6b8a9f): created successfully Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06f7b2-6b1f-4744-97d3-97bdad77119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Flow 'volume_create_manager' (dc45f567-1dc9-4b8d-b38a-a5ce094e608c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5a26216e-6733-4e9d-8b95-e74f1327e36a tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Created volume successfully. Sep 03 13:45:12 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d 1073741824" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:12 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d Sep 03 13:45:12 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:12 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a740fe12-4e8c-4179-9cc2-2ca3f27d3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bdcd89-32d2-44df-aa6a-6901761b6661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Acquiring lock "cinder-f62457cd-09d7-4984-988a-906eba6b8a9f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Volume volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d (bb3c9753-235d-4504-9c3d-f4f3f2c4d31d): created successfully Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bdcd89-32d2-44df-aa6a-6901761b6661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Flow 'volume_create_manager' (44bf2109-4c85-4918-b883-2f8cf5e8c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "cinder-f62457cd-09d7-4984-988a-906eba6b8a9f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-26e95eb5-26e8-47a4-bd77-578111df1aa3 tempest-VolumesGetTest-1902393302 None] Created volume successfully. Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Acquiring lock "cinder-quobyte-f62457cd-09d7-4984-988a-906eba6b8a9f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "cinder-quobyte-f62457cd-09d7-4984-988a-906eba6b8a9f" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529311a-10c3-430c-ac7e-8307377a5949]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:13 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f Sep 03 13:45:13 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:13 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:13 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f Sep 03 13:45:13 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (e42f0f61-0b38-40f3-b888-622f521edd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdea5de-6df7-45f0-85b9-dcb75cbf52c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdea5de-6df7-45f0-85b9-dcb75cbf52c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323512556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:14Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f1b5f1-144f-47b2-821d-41edfb5477b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f1b5f1-144f-47b2-821d-41edfb5477b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d233db0-4c0b-4184-a5df-9dadac9cbf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d233db0-4c0b-4184-a5df-9dadac9cbf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8', 'volume_name': 'volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77686b99-2f6e-4076-a634-3ccb66125ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77686b99-2f6e-4076-a634-3ccb66125ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e46b83-9dee-4166-81dd-9e0b56f516b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:13 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Volume c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8', 'volume_size': 1} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323512556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:14Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Creating volume c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:13 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:13 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 1073741824 Sep 03 13:45:13 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:13 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f62457cd-09d7-4984-988a-906eba6b8a9f" returned: 0 in 0.259s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "cinder-quobyte-f62457cd-09d7-4984-988a-906eba6b8a9f" released by "delete_volume" :: held 0.694s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:13 devstack cinder-volume[86933]: WARNING cinder.quota [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:45:13 devstack cinder-volume[86933]: WARNING cinder.quota [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Created reservations ['331a24c5-f52a-4962-9f11-5a7d06f6c56d', '55276489-4b90-4c54-b0e9-faf1e780c25c', '3155d46d-40bf-4070-9901-f42650f6e843', '6b05b7f5-91bb-4f60-912f-67c8e9c3a791'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:13 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:13 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:14 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 1073741824" returned: 0 in 0.475s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:14 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Deleted volume successfully. Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dc163ef6-f968-4742-b118-6c31f074fc1c tempest-VolumeAndVolumeTypeFromImageTest-74983058 None] Lock "cinder-f62457cd-09d7-4984-988a-906eba6b8a9f-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:14 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 Sep 03 13:45:14 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "cinder-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05a2280-24a5-49ba-b7f0-204ad4338fe5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:14 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" returned: 0 in 0.330s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e46b83-9dee-4166-81dd-9e0b56f516b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ccb952-0eac-4345-b890-9b6f787bf44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:14 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d Sep 03 13:45:14 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Volume volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 (c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8): created successfully Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ccb952-0eac-4345-b890-9b6f787bf44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (e42f0f61-0b38-40f3-b888-622f521edd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4977e485-3c83-4d43-a0f9-b7ac51acfbcb tempest-ProjectReaderTests-254295431 None] Created volume successfully. Sep 03 13:45:14 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" returned: 0 in 0.412s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:14 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d Sep 03 13:45:14 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:15 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d" released by "delete_volume" :: held 0.715s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Created reservations ['6ed5f3f1-f0e5-45bf-9816-3ca56c1367ab', '2f8f5520-c197-4dd7-ad9b-fa05048ae076', '0b2fd04c-1c97-418c-bc30-89129dce7278', '096665af-b974-474b-811a-90827bdfdf3e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:15 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:15 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:15 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.308s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad762280-b9f4-48a0-9640-520f4904a064 tempest-VolumesGetTest-1902393302 None] Lock "cinder-bb3c9753-235d-4504-9c3d-f4f3f2c4d31d-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-f4a881ea-d4db-4e5c-a7de-be20f4b42d53-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "cinder-f4a881ea-d4db-4e5c-a7de-be20f4b42d53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Acquiring lock "cinder-quobyte-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9263f-31b3-4616-bfdd-bc820061e517]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:15 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 Sep 03 13:45:15 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "cinder-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-quobyte-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d8ba62-2c8a-4051-9296-520789cb6622]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:16 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" returned: 0 in 0.429s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:16 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53 Sep 03 13:45:16 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:16 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 Sep 03 13:45:16 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:16 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "cinder-quobyte-f4a881ea-d4db-4e5c-a7de-be20f4b42d53" released by "delete_volume" :: held 0.772s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:16 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Created reservations ['9c01c4e4-ee4a-4d4d-a141-b9ed562497b4', '4381e59d-6f84-49c5-b3f1-08cfba30d38e', 'be9b2f23-4ab4-4b95-a81d-9510d70021d9', '5af0c8c4-c4f4-4ed2-bf5a-42792148a556'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:16 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8 Sep 03 13:45:16 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:16 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:16 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:16 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8" released by "delete_volume" :: held 0.770s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Created reservations ['adb48d10-47a4-4a0d-8dc0-1aae836ba796', '6046e18b-a6f0-4067-8c76-f5cb20922f5e', 'ebe3da53-f4b0-4aed-a0af-af27cf9a6849', 'ac948513-af4a-4499-a1b8-57ee09facc6c'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:16 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.315s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:16 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Deleted volume successfully. Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3f36d303-2f3e-490f-b7c4-6ac427a9d134 tempest-VolumesGetTest-1902393302 None] Lock "cinder-f4a881ea-d4db-4e5c-a7de-be20f4b42d53-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:17 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:17 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:17 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Deleted volume successfully. Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9b55f8d9-90ce-4d00-91ef-3eb93a65c32d tempest-ProjectReaderTests-254295431 None] Lock "cinder-c515ebee-4db1-47a3-b4cd-b4e8ead6e5d8-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (c3893b18-70ec-42cf-96d9-e1015c3a727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7128a037-d458-49a1-b037-7ffa9b9436d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7128a037-d458-49a1-b037-7ffa9b9436d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370572313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e89c24-e7f6-4acc-a282-abcbce2ba241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:18Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa77eba-6c97-4afe-95fa-a8ecd8f27ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa77eba-6c97-4afe-95fa-a8ecd8f27ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4277683d-9e9f-4310-9f47-2cf412a25b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4277683d-9e9f-4310-9f47-2cf412a25b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e89c24-e7f6-4acc-a282-abcbce2ba241', 'volume_name': 'volume-19e89c24-e7f6-4acc-a282-abcbce2ba241', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138374a-c76f-4d87-97f4-4eeb565e71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138374a-c76f-4d87-97f4-4eeb565e71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958e38f-9a0c-40b5-9a75-532e9791f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:17 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Volume 19e89c24-e7f6-4acc-a282-abcbce2ba241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e89c24-e7f6-4acc-a282-abcbce2ba241', 'volume_size': 1} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370572313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e89c24-e7f6-4acc-a282-abcbce2ba241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:18Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Creating volume 19e89c24-e7f6-4acc-a282-abcbce2ba241 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:17 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:17 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 1073741824 Sep 03 13:45:17 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:18 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 1073741824" returned: 0 in 0.498s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:18 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 Sep 03 13:45:18 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:18 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958e38f-9a0c-40b5-9a75-532e9791f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e89c24-e7f6-4acc-a282-abcbce2ba241', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87bdb23-c8de-49b9-a265-8398fc9a3f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:18 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Volume volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 (19e89c24-e7f6-4acc-a282-abcbce2ba241): created successfully Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87bdb23-c8de-49b9-a265-8398fc9a3f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (c3893b18-70ec-42cf-96d9-e1015c3a727c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9c4f33ff-8c86-4042-9029-b247952d6f44 tempest-ProjectReaderTests-254295431 None] Created volume successfully. Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (ecf76504-39f4-4700-a871-7af0026edfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2848a3-393c-41b0-a6e5-9393919186d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2848a3-393c-41b0-a6e5-9393919186d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296363420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3605c184-565a-4e5b-a58b-bff8b54af492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:19Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ab32f6-2379-469d-a80a-2799e5be46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ab32f6-2379-469d-a80a-2799e5be46c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453027de-0404-422e-8333-6e626e380725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453027de-0404-422e-8333-6e626e380725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3605c184-565a-4e5b-a58b-bff8b54af492', 'volume_name': 'volume-3605c184-565a-4e5b-a58b-bff8b54af492', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7246501a-48ad-466b-80f6-4302c286c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7246501a-48ad-466b-80f6-4302c286c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8dd185-23c9-4e74-aa51-8996c2cb1643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:19 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume 3605c184-565a-4e5b-a58b-bff8b54af492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3605c184-565a-4e5b-a58b-bff8b54af492', 'volume_size': 1} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296363420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3605c184-565a-4e5b-a58b-bff8b54af492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:19Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume 3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:19 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:19 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 1073741824 Sep 03 13:45:19 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:19 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 1073741824" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:19 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 Sep 03 13:45:19 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-19e89c24-e7f6-4acc-a282-abcbce2ba241-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "cinder-19e89c24-e7f6-4acc-a282-abcbce2ba241-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-quobyte-19e89c24-e7f6-4acc-a282-abcbce2ba241" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-19e89c24-e7f6-4acc-a282-abcbce2ba241" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfeb6ee-fd6e-4af1-8c41-9f609d4f015a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:20 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492" returned: 0 in 0.292s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8dd185-23c9-4e74-aa51-8996c2cb1643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3605c184-565a-4e5b-a58b-bff8b54af492', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283cf999-83e8-408f-9f01-23abab74b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-3605c184-565a-4e5b-a58b-bff8b54af492 (3605c184-565a-4e5b-a58b-bff8b54af492): created successfully Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283cf999-83e8-408f-9f01-23abab74b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (ecf76504-39f4-4700-a871-7af0026edfa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:20 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ec1458b0-d7f7-4e02-800e-73358f4ca78a tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:20 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 Sep 03 13:45:20 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Flow 'volume_create_manager' (2a615f71-00f4-4d44-9388-f529a2322231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611794c0-8e4d-4a1b-8c2e-b7e800037098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611794c0-8e4d-4a1b-8c2e-b7e800037098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1298863846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ed55f7-fc2f-4d53-a768-805c1986a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffc572411cb4eb98929f91485addbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:20Z,use_quota=True,user_id='b4cd927fe2e143bcbe95058941af7b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a720818e-acd7-4c09-862a-8424b6ec11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a720818e-acd7-4c09-862a-8424b6ec11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e7afd-ee0b-4234-8b02-a83ae7cbd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e7afd-ee0b-4234-8b02-a83ae7cbd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ed55f7-fc2f-4d53-a768-805c1986a09a', 'volume_name': 'volume-66ed55f7-fc2f-4d53-a768-805c1986a09a', 'volume_size': 2}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adea542-82ce-41b5-87e5-ab402a54d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adea542-82ce-41b5-87e5-ab402a54d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a54fa3-6cff-4774-93c1-cd3c3bfd6dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:20 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Volume 66ed55f7-fc2f-4d53-a768-805c1986a09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ed55f7-fc2f-4d53-a768-805c1986a09a', 'volume_size': 2} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1298863846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ed55f7-fc2f-4d53-a768-805c1986a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffc572411cb4eb98929f91485addbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:20Z,use_quota=True,user_id='b4cd927fe2e143bcbe95058941af7b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Creating volume 66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:20 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a 2147483648 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241" returned: 0 in 0.433s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:20 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a 2147483648 Sep 03 13:45:20 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:20 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241 Sep 03 13:45:20 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:20 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-19e89c24-e7f6-4acc-a282-abcbce2ba241" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-19e89c24-e7f6-4acc-a282-abcbce2ba241" released by "delete_volume" :: held 0.727s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Created reservations ['8e3f925e-7529-40ad-9ab2-ca74e64f45cb', 'e688f647-201b-47cf-b715-4094aa7f8e7b', '9d3559fe-0078-43f1-90bf-21f4fb1fe4d3', '1962ec65-beb7-4a80-aa9a-8d06383087e0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:20 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:20 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:20 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a 2147483648" returned: 0 in 0.508s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:21 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a Sep 03 13:45:21 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:21 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Deleted volume successfully. Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-317fd36d-8b16-497f-9e63-232aa8dd87c8 tempest-ProjectReaderTests-254295431 None] Lock "cinder-19e89c24-e7f6-4acc-a282-abcbce2ba241-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:21 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a54fa3-6cff-4774-93c1-cd3c3bfd6dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ed55f7-fc2f-4d53-a768-805c1986a09a', 'volume_size': 2}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e81bc5f-5f72-4001-8756-6da99113e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Volume volume-66ed55f7-fc2f-4d53-a768-805c1986a09a (66ed55f7-fc2f-4d53-a768-805c1986a09a): created successfully Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e81bc5f-5f72-4001-8756-6da99113e722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Flow 'volume_create_manager' (2a615f71-00f4-4d44-9388-f529a2322231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f1c84217-6a96-419e-8a91-78be59b89f73 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Created volume successfully. Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (9ded8d84-16c3-473e-aa3c-8081164cd372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc289122-0d0f-4351-8c59-8527aa52e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating offline snapshot 1c720fd5-52c2-4d29-9166-a37d0bfe1b82 of volume 3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc289122-0d0f-4351-8c59-8527aa52e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850324397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ef43e5-afbb-411a-adb6-71800c6463d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:22Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cb8c24-39a5-49b1-9cbf-afc86cb870cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cb8c24-39a5-49b1-9cbf-afc86cb870cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33b04b-bec3-4595-9edd-a09f2c686bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33b04b-bec3-4595-9edd-a09f2c686bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ef43e5-afbb-411a-adb6-71800c6463d1', 'volume_name': 'volume-07ef43e5-afbb-411a-adb6-71800c6463d1', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d3998d-55b1-41b9-b09e-8094e2cc0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d3998d-55b1-41b9-b09e-8094e2cc0da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92807f81-a649-4286-abe7-4cd0f198de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Volume 07ef43e5-afbb-411a-adb6-71800c6463d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ef43e5-afbb-411a-adb6-71800c6463d1', 'volume_size': 1} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea54fbc-99cb-4124-b778-d78b3ddf0324]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:21 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 Sep 03 13:45:21 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:22 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:22 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 1G Sep 03 13:45:22 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:22 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 1G" returned: 0 in 0.381s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3605c184-565a-4e5b-a58b-bff8b54af492 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:22 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3605c184-565a-4e5b-a58b-bff8b54af492 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 Sep 03 13:45:22 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:22 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3605c184-565a-4e5b-a58b-bff8b54af492 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82" returned: 0 in 0.295s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:22 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 is being set with open permissions: ugo+rw Sep 03 13:45:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:22 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 Sep 03 13:45:22 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82" returned: 0 in 0.239s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:23 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info Sep 03 13:45:23 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:23 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:23 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info is being set with open permissions: ugo+rw Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:23 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info Sep 03 13:45:23 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:23 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.info" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850324397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ef43e5-afbb-411a-adb6-71800c6463d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:22Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Creating volume 07ef43e5-afbb-411a-adb6-71800c6463d1 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:23 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:23 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 1073741824 Sep 03 13:45:23 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:23 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8988fed3-9ab4-4078-af74-0440735a0269 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Create snapshot completed successfully Sep 03 13:45:24 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 1073741824" returned: 0 in 0.394s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:24 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 Sep 03 13:45:24 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:24 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1" returned: 0 in 0.239s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.475s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92807f81-a649-4286-abe7-4cd0f198de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ef43e5-afbb-411a-adb6-71800c6463d1', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ed4820-8b84-4cb7-9977-4887d4e322bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Creating offline snapshot ce86ebde-49b7-45b9-8755-2ed3252ebcc1 of volume 66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:45:24 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Volume volume-07ef43e5-afbb-411a-adb6-71800c6463d1 (07ef43e5-afbb-411a-adb6-71800c6463d1): created successfully Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ed4820-8b84-4cb7-9977-4887d4e322bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (9ded8d84-16c3-473e-aa3c-8081164cd372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319cd23-706a-40a3-9afe-d6aa24f70c65]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c4ff4b04-df2e-46e1-b6b2-14ec76f39689 tempest-ProjectReaderTests-254295431 None] Created volume successfully. Sep 03 13:45:24 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a Sep 03 13:45:24 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:24 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 2G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:24 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 2G Sep 03 13:45:24 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-07ef43e5-afbb-411a-adb6-71800c6463d1-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "cinder-07ef43e5-afbb-411a-adb6-71800c6463d1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-quobyte-07ef43e5-afbb-411a-adb6-71800c6463d1" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-07ef43e5-afbb-411a-adb6-71800c6463d1" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[680122a3-bb2b-48e6-9659-0da2c16e92c8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:25 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 Sep 03 13:45:25 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:25 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 2G" returned: 0 in 0.525s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ed55f7-fc2f-4d53-a768-805c1986a09a -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:25 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ed55f7-fc2f-4d53-a768-805c1986a09a -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 Sep 03 13:45:25 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (88512a84-f53e-4948-82c7-2f1c56c810be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8044b9-9883-4806-bd49-b3c11fcd65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8044b9-9883-4806-bd49-b3c11fcd65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973212265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12625e7f-b001-43b7-8079-a6147466c0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:25Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f7c669-4f78-4d59-94eb-22d5a3d58c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f7c669-4f78-4d59-94eb-22d5a3d58c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad439def-c9ee-4784-878c-0cef590446f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad439def-c9ee-4784-878c-0cef590446f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12625e7f-b001-43b7-8079-a6147466c0bd', 'volume_name': 'volume-12625e7f-b001-43b7-8079-a6147466c0bd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c063209a-933e-4ada-89f3-087c10f988f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c063209a-933e-4ada-89f3-087c10f988f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352ebbff-2880-41da-9af3-ce9a380bc644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume 12625e7f-b001-43b7-8079-a6147466c0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12625e7f-b001-43b7-8079-a6147466c0bd', 'volume_size': 1} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:25 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:25 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1 Sep 03 13:45:25 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:25 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ed55f7-fc2f-4d53-a768-805c1986a09a -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1" returned: 0 in 0.342s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:25 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 is being set with open permissions: ugo+rw Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:25 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 Sep 03 13:45:25 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:25 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-07ef43e5-afbb-411a-adb6-71800c6463d1" returned: 0 in 0.345s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-07ef43e5-afbb-411a-adb6-71800c6463d1" released by "delete_volume" :: held 0.832s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (8bab1113-8b88-4939-a6a1-34813f826d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:25 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93d12b-de9d-447b-b9f9-c221d090738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Created reservations ['bf86064e-20ad-406f-a44e-52fcbde3f34b', 'df7c4213-51c1-40f6-84fb-c352123ab474', '93935f13-9d63-4c09-bf21-a375a94931cf', 'fed1867c-831f-49a5-80bb-8bf86c0aa753'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1" returned: 0 in 0.309s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93d12b-de9d-447b-b9f9-c221d090738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-967006387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9b43f8-824b-4103-b01e-26bfe7811cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d29bea-2bbc-479f-a9ac-7178df0b70e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d29bea-2bbc-479f-a9ac-7178df0b70e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c1eac-e84a-4131-a1cc-301bad22d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c1eac-e84a-4131-a1cc-301bad22d340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9b43f8-824b-4103-b01e-26bfe7811cb8', 'volume_name': 'volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781792ca-fa43-4874-8e8b-a160ffd3bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781792ca-fa43-4874-8e8b-a160ffd3bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06179b8-4238-4ff0-bc78-4575b7086d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:25 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume 0b9b43f8-824b-4103-b01e-26bfe7811cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8', 'volume_size': 1} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:26 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info Sep 03 13:45:26 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:26 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:26 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (2c399c95-e191-474a-99ce-b18a23df1199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58923069-0c06-4275-b9b9-3273d5b53387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58923069-0c06-4275-b9b9-3273d5b53387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111432372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc2598-381d-41dc-8bfc-cefae7b9aa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ff1a2-1c9e-485c-a7c4-4a068bdeef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ff1a2-1c9e-485c-a7c4-4a068bdeef05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40e973e-c9b3-46b2-9a71-61946eaf4e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40e973e-c9b3-46b2-9a71-61946eaf4e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcc2598-381d-41dc-8bfc-cefae7b9aa33', 'volume_name': 'volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c720e3-d42c-4561-8557-fb4ba038a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c720e3-d42c-4561-8557-fb4ba038a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7885690a-ac5f-46dc-8e7e-e9b061474bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume dbcc2598-381d-41dc-8bfc-cefae7b9aa33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33', 'volume_size': 1} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:26 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info" returned: 0 in 0.301s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:26 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info is being set with open permissions: ugo+rw Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:26 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info Sep 03 13:45:26 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:26 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.330s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Deleted volume successfully. Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-997970fd-d501-4f36-8f0f-ed2234d7065c tempest-ProjectReaderTests-254295431 None] Lock "cinder-07ef43e5-afbb-411a-adb6-71800c6463d1-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (d7cac18a-cdeb-4055-9b90-f740137d46a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa0d5e-06e4-4aea-a772-5bfc63c1ca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa0d5e-06e4-4aea-a772-5bfc63c1ca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-340296427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14672c9-623d-4fdf-8f2e-68dbaa61c099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7828a094-6111-4160-905c-709cdda94c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7828a094-6111-4160-905c-709cdda94c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0086f1-e7cf-4406-9a06-d2e91aa2562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0086f1-e7cf-4406-9a06-d2e91aa2562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14672c9-623d-4fdf-8f2e-68dbaa61c099', 'volume_name': 'volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3f195-71fd-4f23-9f0b-e8bd8cec3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3f195-71fd-4f23-9f0b-e8bd8cec3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03d63d-c4c7-4f3c-bf87-a28bfc1c1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume b14672c9-623d-4fdf-8f2e-68dbaa61c099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099', 'volume_size': 1} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:26 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.info" returned: 0 in 0.307s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973212265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12625e7f-b001-43b7-8079-a6147466c0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:25Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume 12625e7f-b001-43b7-8079-a6147466c0bd {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:26 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd 1073741824 Sep 03 13:45:26 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0d7ab5f2-e84d-43d2-8b5e-0ba93b43fc5d tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Create snapshot completed successfully Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (3fc4400f-036d-4a5e-a332-a7151d5f2afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2fa95d-1a55-4705-8c8d-4e7aeb78c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2fa95d-1a55-4705-8c8d-4e7aeb78c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346473677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d929f8-fc9b-420a-99fa-ef2946cf6196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:27Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e261e628-7cb8-43e7-ad70-bdfe70728590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e261e628-7cb8-43e7-ad70-bdfe70728590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786f0248-1f03-4c23-8f1c-a82445d78a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786f0248-1f03-4c23-8f1c-a82445d78a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d929f8-fc9b-420a-99fa-ef2946cf6196', 'volume_name': 'volume-57d929f8-fc9b-420a-99fa-ef2946cf6196', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3e363d-2101-4763-85eb-ac09275cbcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3e363d-2101-4763-85eb-ac09275cbcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3202ce-c2aa-4c30-89f5-871cd23fb181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume 57d929f8-fc9b-420a-99fa-ef2946cf6196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d929f8-fc9b-420a-99fa-ef2946cf6196', 'volume_size': 1} Sep 03 13:45:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "cinder-ce86ebde-49b7-45b9-8755-2ed3252ebcc1-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-ce86ebde-49b7-45b9-8755-2ed3252ebcc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "cinder-quobyte-ce86ebde-49b7-45b9-8755-2ed3252ebcc1" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-ce86ebde-49b7-45b9-8755-2ed3252ebcc1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Deleting offline snapshot ce86ebde-49b7-45b9-8755-2ed3252ebcc1 of volume 66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:45:27 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] snapshot_file for this snap is: volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd 1073741824" returned: 0 in 0.516s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb050d3-199d-4247-b608-983070f6a048]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:27 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd Sep 03 13:45:27 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:27 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 Sep 03 13:45:27 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:27 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd" returned: 0 in 0.325s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-967006387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9b43f8-824b-4103-b01e-26bfe7811cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume 0b9b43f8-824b-4103-b01e-26bfe7811cb8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:27 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352ebbff-2880-41da-9af3-ce9a380bc644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12625e7f-b001-43b7-8079-a6147466c0bd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a3a2e-4d18-4cb2-b51f-793cf04b3514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 1073741824 Sep 03 13:45:27 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:27 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ed55f7-fc2f-4d53-a768-805c1986a09a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22dd638-de99-4644-8d3c-22a6c4c03fbc]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:27 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-12625e7f-b001-43b7-8079-a6147466c0bd (12625e7f-b001-43b7-8079-a6147466c0bd): created successfully Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a3a2e-4d18-4cb2-b51f-793cf04b3514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (88512a84-f53e-4948-82c7-2f1c56c810be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-92dea3fd-44e6-4b10-9a7c-bd3e2a495944 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (18093fff-ed6c-459a-8ff6-41a3edb3bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e6c798-d432-41e2-b7b9-fb7c24abac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e6c798-d432-41e2-b7b9-fb7c24abac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001623735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca06f59-a54c-4da8-8c7a-40eb3536b325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:28Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a033e69-2403-4c1d-b705-663e67334316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a033e69-2403-4c1d-b705-663e67334316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b705d431-5939-4978-a216-b2ceceea2b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b705d431-5939-4978-a216-b2ceceea2b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca06f59-a54c-4da8-8c7a-40eb3536b325', 'volume_name': 'volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b59d7b-88d5-4717-9f78-687b847a63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b59d7b-88d5-4717-9f78-687b847a63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:27 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a Sep 03 13:45:27 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e441e09a-da96-49f3-9c06-0fcddee2b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:27 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Volume 0ca06f59-a54c-4da8-8c7a-40eb3536b325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325', 'volume_size': 1} Sep 03 13:45:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:28 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 1073741824" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:28 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a" returned: 0 in 0.412s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:28 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 Sep 03 13:45:28 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:28 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 Sep 03 13:45:28 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:28 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.101s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111432372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc2598-381d-41dc-8bfc-cefae7b9aa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume dbcc2598-381d-41dc-8bfc-cefae7b9aa33 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06179b8-4238-4ff0-bc78-4575b7086d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d68403f-bab3-4c1c-8a5e-08641e5ba419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:28 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 1073741824 Sep 03 13:45:28 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:28 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 (0b9b43f8-824b-4103-b01e-26bfe7811cb8): created successfully Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d68403f-bab3-4c1c-8a5e-08641e5ba419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (8bab1113-8b88-4939-a6a1-34813f826d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1348d4e8-3abb-4724-a6e9-e7b4bd84acf0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:28 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:28 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1 Sep 03 13:45:28 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:28 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a.ce86ebde-49b7-45b9-8755-2ed3252ebcc1" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-ce86ebde-49b7-45b9-8755-2ed3252ebcc1" released by "_delete_snapshot" :: held 1.587s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" released by "delete_snapshot" :: held 1.609s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:28 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 1073741824" returned: 0 in 0.426s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:28 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 Sep 03 13:45:28 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Created reservations ['d46a3220-2623-4f8e-8f4b-62feba246e35', '8e29ffb8-3a5f-4e7f-859c-c3a16be98b2d', '2f68e077-09dd-4dca-a555-98ecb0b8070f', '98228bdf-dd67-4ef8-bf22-c5ddbdc9cf9b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Delete snapshot completed successfully. Sep 03 13:45:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b6e7673-39d3-4a00-b0f0-6f749efd7f08 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-ce86ebde-49b7-45b9-8755-2ed3252ebcc1-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:29 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-340296427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14672c9-623d-4fdf-8f2e-68dbaa61c099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:26Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume b14672c9-623d-4fdf-8f2e-68dbaa61c099 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7885690a-ac5f-46dc-8e7e-e9b061474bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:29 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 1073741824 Sep 03 13:45:29 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a9e5b4-fb0e-49cb-aba8-306dfd2f7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 (dbcc2598-381d-41dc-8bfc-cefae7b9aa33): created successfully Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a9e5b4-fb0e-49cb-aba8-306dfd2f7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (2c399c95-e191-474a-99ce-b18a23df1199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-45306148-8c68-48e9-9f5f-5acc29d1db72 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "cinder-66ed55f7-fc2f-4d53-a768-805c1986a09a-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-66ed55f7-fc2f-4d53-a768-805c1986a09a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa64733-0dee-49a0-897c-231eca6f46b0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:29 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 1073741824" returned: 0 in 0.480s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:29 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a Sep 03 13:45:29 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:29 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 Sep 03 13:45:29 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:29 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a" returned: 0 in 0.384s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:29 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a Sep 03 13:45:29 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:29 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.918s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346473677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d929f8-fc9b-420a-99fa-ef2946cf6196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687401d99814926ac343084b83d167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:27Z,use_quota=True,user_id='2d2f2861415046219859f01d61d90d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Creating volume 57d929f8-fc9b-420a-99fa-ef2946cf6196 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03d63d-c4c7-4f3c-bf87-a28bfc1c1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:29 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 1073741824 Sep 03 13:45:29 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7406d5d-0a95-4067-8f37-b1c1b837e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 (b14672c9-623d-4fdf-8f2e-68dbaa61c099): created successfully Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7406d5d-0a95-4067-8f37-b1c1b837e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (d7cac18a-cdeb-4055-9b90-f740137d46a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fb09ea0e-fc1d-4e9e-bda9-df6b706cbf60 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:30 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-66ed55f7-fc2f-4d53-a768-805c1986a09a" returned: 0 in 0.255s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-quobyte-66ed55f7-fc2f-4d53-a768-805c1986a09a" released by "delete_volume" :: held 0.705s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Created reservations ['3246e357-97d6-45d8-a9aa-7ba644e55dfe', '73c73cc4-aabb-49b0-9385-83ddd4ecc67c', 'd8f00ec0-3db4-492b-b7b6-fa16eb2df0c3', '23c88450-1aa1-4c97-8415-cc3cf35d624e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:30 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:30 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:30 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 1073741824" returned: 0 in 0.468s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:30 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 Sep 03 13:45:30 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:30 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.262s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Deleted volume successfully. Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f42af22f-5e3b-47b2-a427-68536e97f9d1 tempest-VolumesSnapshotNegativeTestJSON-1296044644 None] Lock "cinder-66ed55f7-fc2f-4d53-a768-805c1986a09a-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:30 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196" returned: 0 in 0.272s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001623735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca06f59-a54c-4da8-8c7a-40eb3536b325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d8aa204b24f408c4f2d300a0b2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:28Z,use_quota=True,user_id='681f1458dedc44b4bf66998cbcabc779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Creating volume 0ca06f59-a54c-4da8-8c7a-40eb3536b325 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3202ce-c2aa-4c30-89f5-871cd23fb181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d929f8-fc9b-420a-99fa-ef2946cf6196', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8d0b31-1fce-4d05-a33a-01a8cf76090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:30 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 1073741824 Sep 03 13:45:30 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Volume volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 (57d929f8-fc9b-420a-99fa-ef2946cf6196): created successfully Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8d0b31-1fce-4d05-a33a-01a8cf76090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Flow 'volume_create_manager' (3fc4400f-036d-4a5e-a332-a7151d5f2afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a8ac207-5547-465a-8c1f-7cab9e194ec0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created volume successfully. Sep 03 13:45:31 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 1073741824" returned: 0 in 0.527s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:31 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 Sep 03 13:45:31 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-57d929f8-fc9b-420a-99fa-ef2946cf6196-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-57d929f8-fc9b-420a-99fa-ef2946cf6196-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-57d929f8-fc9b-420a-99fa-ef2946cf6196" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-57d929f8-fc9b-420a-99fa-ef2946cf6196" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29df24-bbcb-4088-880a-91b605710006]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:31 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325" returned: 0 in 0.428s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:31 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 Sep 03 13:45:31 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e441e09a-da96-49f3-9c06-0fcddee2b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebc30bd-d2c5-49b1-b4b3-9f936d9edec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Volume volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 (0ca06f59-a54c-4da8-8c7a-40eb3536b325): created successfully Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebc30bd-d2c5-49b1-b4b3-9f936d9edec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Flow 'volume_create_manager' (18093fff-ed6c-459a-8ff6-41a3edb3bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b054ac4a-594e-4074-a823-e816ef17be03 tempest-ProjectReaderTests-254295431 None] Created volume successfully. Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-0ca06f59-a54c-4da8-8c7a-40eb3536b325-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "cinder-0ca06f59-a54c-4da8-8c7a-40eb3536b325-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Acquiring lock "cinder-quobyte-0ca06f59-a54c-4da8-8c7a-40eb3536b325" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:32 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196" returned: 0 in 0.458s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-0ca06f59-a54c-4da8-8c7a-40eb3536b325" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:32 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196 Sep 03 13:45:32 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d4da3-e99c-40b1-bf20-acc5d63a35c9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:32 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 Sep 03 13:45:32 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:32 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-57d929f8-fc9b-420a-99fa-ef2946cf6196" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-57d929f8-fc9b-420a-99fa-ef2946cf6196" released by "delete_volume" :: held 0.783s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['0c1d0c5e-22cd-4acd-a666-35d018af0df3', '86b80b93-9bad-431f-8173-4a5fa9acc6b9', 'ef17c64a-0fa9-4ceb-a55a-5b9318286f55', 'f99d7bb9-9003-48b3-8738-f2878280f5e0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:32 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:32 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325 Sep 03 13:45:32 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:32 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:32 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-b14672c9-623d-4fdf-8f2e-68dbaa61c099-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-b14672c9-623d-4fdf-8f2e-68dbaa61c099-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-b14672c9-623d-4fdf-8f2e-68dbaa61c099" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-b14672c9-623d-4fdf-8f2e-68dbaa61c099" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:32 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0ca06f59-a54c-4da8-8c7a-40eb3536b325" returned: 0 in 0.332s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5466e-761c-4b2d-8efa-c86cb07d1eda]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "cinder-quobyte-0ca06f59-a54c-4da8-8c7a-40eb3536b325" released by "delete_volume" :: held 0.799s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:32 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c52e7d71-cb79-4b65-92fb-71376b819ab0 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-57d929f8-fc9b-420a-99fa-ef2946cf6196-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Created reservations ['da40fa3e-2669-4db7-bc54-ceeed91a9b8b', '60ea5dbb-6532-4982-8b50-ed6f401ad91c', '7fd13512-a842-4a2f-8eb4-bbaeadabbfb3', '1f4911f1-5f82-4435-ac9c-22e30d454fed'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:32 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 Sep 03 13:45:32 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:33 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:33 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:33 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:33 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099" returned: 0 in 0.464s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.309s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Deleted volume successfully. Sep 03 13:45:33 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099 Sep 03 13:45:33 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-873f7c19-a2e7-451d-8d2a-6f3616cd4a72 tempest-ProjectReaderTests-254295431 None] Lock "cinder-0ca06f59-a54c-4da8-8c7a-40eb3536b325-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:33 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b14672c9-623d-4fdf-8f2e-68dbaa61c099" returned: 0 in 0.282s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-b14672c9-623d-4fdf-8f2e-68dbaa61c099" released by "delete_volume" :: held 0.811s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['8ed73686-4caa-49a6-b1db-3a7be02dc82b', '4365fcf6-9ab7-4ddc-b395-b24218b3728f', '1b7c2616-79b1-4a5c-b2a5-c0c9301662f1', '1d62a989-75f1-4323-a73a-6b4005228c72'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:33 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:33 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:33 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:33 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-dbcc2598-381d-41dc-8bfc-cefae7b9aa33-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-dbcc2598-381d-41dc-8bfc-cefae7b9aa33-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de69f47-d042-432a-a235-c12fb5e78496]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:34 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.440s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:45:34 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:34 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:34 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 Sep 03 13:45:34 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c3f6c5af-c35c-4316-99e4-f0a692c7d87c tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-b14672c9-623d-4fdf-8f2e-68dbaa61c099-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:34 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" returned: 0 in 0.478s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:34 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33 Sep 03 13:45:34 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:34 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-dbcc2598-381d-41dc-8bfc-cefae7b9aa33" released by "delete_volume" :: held 0.852s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:34 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['e4bb0311-495c-4b1d-ad03-b824be31637d', 'ce9b15ed-2f33-4c70-b2e5-07d6de10b850', 'abe2bcf0-854e-433d-bc41-916bef2bc319', '50c27887-8986-4428-ad8c-a686039cd3bf'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:35 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:35 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-0b9b43f8-824b-4103-b01e-26bfe7811cb8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-0b9b43f8-824b-4103-b01e-26bfe7811cb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-0b9b43f8-824b-4103-b01e-26bfe7811cb8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-0b9b43f8-824b-4103-b01e-26bfe7811cb8" acquired by "delete_volume" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d3321-5c4c-4fbb-968c-890416b778a8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:35 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.372s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af714832-acf4-4ca2-92fd-062c51995332 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-dbcc2598-381d-41dc-8bfc-cefae7b9aa33-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:35 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 Sep 03 13:45:35 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:35 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:35 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8 Sep 03 13:45:35 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:36 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0b9b43f8-824b-4103-b01e-26bfe7811cb8" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-0b9b43f8-824b-4103-b01e-26bfe7811cb8" released by "delete_volume" :: held 0.718s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['5fd0754f-65d1-4b2e-8c1c-c866519dd920', 'ec41b197-3b08-4b9e-b7c4-fd1023c256da', 'c7bc6eb2-0163-4b86-85b6-a1afaffd4041', '67cd147e-0882-4786-aa7f-82a36c12f1d1'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:36 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:36 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:36 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-12625e7f-b001-43b7-8079-a6147466c0bd-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-12625e7f-b001-43b7-8079-a6147466c0bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e8c8aad3-2205-4ada-8854-7b6073a0a261 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-0b9b43f8-824b-4103-b01e-26bfe7811cb8-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-12625e7f-b001-43b7-8079-a6147466c0bd" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-12625e7f-b001-43b7-8079-a6147466c0bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e62ad-2807-4947-911f-2e5ccfd040b8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:36 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd Sep 03 13:45:36 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:36 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd" returned: 0 in 0.376s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:37 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd Sep 03 13:45:37 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:37 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-12625e7f-b001-43b7-8079-a6147466c0bd" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-12625e7f-b001-43b7-8079-a6147466c0bd" released by "delete_volume" :: held 0.665s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['775542b0-edd2-48e2-8ca6-f148a1e92de8', '540f136d-7bed-4c51-af92-b4d72202c0bd', 'd44b2059-5946-40c9-b7f9-6a9a9c217ab4', '65a4cc7c-413b-45ed-8759-967bd0f910c4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:37 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:37 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:37 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-1c720fd5-52c2-4d29-9166-a37d0bfe1b82-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-1c720fd5-52c2-4d29-9166-a37d0bfe1b82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-833a0998-86dd-4d1a-9ff3-fb93ef0b21ef tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-12625e7f-b001-43b7-8079-a6147466c0bd-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-1c720fd5-52c2-4d29-9166-a37d0bfe1b82" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-1c720fd5-52c2-4d29-9166-a37d0bfe1b82" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleting offline snapshot 1c720fd5-52c2-4d29-9166-a37d0bfe1b82 of volume 3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] snapshot_file for this snap is: volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a71a0-d87f-4f85-b512-3bf67de25d0c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:37 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 Sep 03 13:45:37 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:38 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82" returned: 0 in 0.380s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3605c184-565a-4e5b-a58b-bff8b54af492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[df569195-3b33-4fb8-9b0d-e888f843329f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:38 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 Sep 03 13:45:38 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:38 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492" returned: 0 in 0.386s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:38 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 Sep 03 13:45:38 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:38 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:39 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82 Sep 03 13:45:39 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:39 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492.1c720fd5-52c2-4d29-9166-a37d0bfe1b82" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-1c720fd5-52c2-4d29-9166-a37d0bfe1b82" released by "_delete_snapshot" :: held 1.534s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" released by "delete_snapshot" :: held 1.557s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['7542250a-971e-4350-a411-d335de412bd6', 'e82fad99-6dc1-483b-8442-7c20444ab4fd', 'cfc64f8d-b0de-4d36-8670-c2cdcda94dea', 'c559aff6-0415-4eb6-89f7-0d2720874346'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Delete snapshot completed successfully. Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-031aa543-68cc-4334-8d39-ff608ce70754 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-1c720fd5-52c2-4d29-9166-a37d0bfe1b82-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-3605c184-565a-4e5b-a58b-bff8b54af492-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-3605c184-565a-4e5b-a58b-bff8b54af492-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dedb805-022e-4dfb-b30f-6f75db53fb83]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:40 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 Sep 03 13:45:40 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:40 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492" returned: 0 in 0.393s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:40 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492 Sep 03 13:45:40 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:40 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3605c184-565a-4e5b-a58b-bff8b54af492" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-quobyte-3605c184-565a-4e5b-a58b-bff8b54af492" released by "delete_volume" :: held 0.759s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Created reservations ['48d68bd6-bd04-40f3-b0dd-053326343e15', '8a71bdd9-f77c-4a7b-813c-8b48fd3ba933', '7f641767-6ac2-4617-8b2a-64e5333a655f', '4d020b84-4705-4cc0-8bb9-c20acbb271d4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:40 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:40 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:41 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:41 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Deleted volume successfully. Sep 03 13:45:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0b6a1188-3b4b-4c31-a38c-27bd99099e85 tempest-CreateVolumesFromSnapshotTest-1233080421 None] Lock "cinder-3605c184-565a-4e5b-a58b-bff8b54af492-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (17392ab4-ffc0-4dbc-baa5-ec6a064da076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea59bf2-f59b-4a6b-8d2c-9c7a4dd0fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea59bf2-f59b-4a6b-8d2c-9c7a4dd0fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478344187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c50e109-7a56-499b-87fd-423aad09dcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:44Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e08700-70fc-4d40-bcd3-bdbadc0da95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e08700-70fc-4d40-bcd3-bdbadc0da95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8958083c-9626-4337-bb39-a1a97fffec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8958083c-9626-4337-bb39-a1a97fffec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c50e109-7a56-499b-87fd-423aad09dcb8', 'volume_name': 'volume-2c50e109-7a56-499b-87fd-423aad09dcb8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30944778-0f1b-40f5-ad15-2296ea5fdb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30944778-0f1b-40f5-ad15-2296ea5fdb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ae0da1-871a-461a-b80f-a846d9bc37ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume 2c50e109-7a56-499b-87fd-423aad09dcb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c50e109-7a56-499b-87fd-423aad09dcb8', 'volume_size': 1} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478344187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c50e109-7a56-499b-87fd-423aad09dcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:44Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume 2c50e109-7a56-499b-87fd-423aad09dcb8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:44 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:44 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 1073741824 Sep 03 13:45:44 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:44 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 1073741824" returned: 0 in 0.464s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:44 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 Sep 03 13:45:44 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:44 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ae0da1-871a-461a-b80f-a846d9bc37ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c50e109-7a56-499b-87fd-423aad09dcb8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a56d021-2b4e-4c83-a66f-66a6b2d2146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-2c50e109-7a56-499b-87fd-423aad09dcb8 (2c50e109-7a56-499b-87fd-423aad09dcb8): created successfully Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a56d021-2b4e-4c83-a66f-66a6b2d2146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (17392ab4-ffc0-4dbc-baa5-ec6a064da076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-47363d0e-dd79-497b-a253-3e56b3a71890 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (5eb583cc-f570-49b3-8c56-c74a5a9aaa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbccd232-92b9-4844-9ae8-a2335d0f0aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbccd232-92b9-4844-9ae8-a2335d0f0aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476747522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e3cebf-5c86-400a-9db5-883348bcf548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10536f3-8203-484e-b092-5f5c4fbb388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10536f3-8203-484e-b092-5f5c4fbb388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f53df7-1149-4d3b-924f-bb14d85c652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f53df7-1149-4d3b-924f-bb14d85c652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e3cebf-5c86-400a-9db5-883348bcf548', 'volume_name': 'volume-21e3cebf-5c86-400a-9db5-883348bcf548', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97de9fe7-44eb-4ca7-a6ac-d9f0d8eeb37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97de9fe7-44eb-4ca7-a6ac-d9f0d8eeb37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7318f5f-ebbc-4b0c-adb3-98118568262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:45 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume 21e3cebf-5c86-400a-9db5-883348bcf548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e3cebf-5c86-400a-9db5-883348bcf548', 'volume_size': 1} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476747522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e3cebf-5c86-400a-9db5-883348bcf548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume 21e3cebf-5c86-400a-9db5-883348bcf548 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:45 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:45 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 1073741824 Sep 03 13:45:45 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (5e923284-f2e1-4c4d-bdad-1896b517095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a292f5a5-3650-46c5-b812-09cf3b00b23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a292f5a5-3650-46c5-b812-09cf3b00b23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771812097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d25e07-e863-4156-8134-ec5de8327ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce71dd8-a6a3-4130-88b6-60a374abaa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce71dd8-a6a3-4130-88b6-60a374abaa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a05447-4b03-4c69-ae67-91f18363ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a05447-4b03-4c69-ae67-91f18363ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d25e07-e863-4156-8134-ec5de8327ee9', 'volume_name': 'volume-f4d25e07-e863-4156-8134-ec5de8327ee9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b85a4f-3cfe-42db-afaf-6bb59ccf263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b85a4f-3cfe-42db-afaf-6bb59ccf263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727e91b8-b49f-4d08-84c6-ccfa668e96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume f4d25e07-e863-4156-8134-ec5de8327ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d25e07-e863-4156-8134-ec5de8327ee9', 'volume_size': 1} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:46 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 1073741824" returned: 0 in 0.574s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:46 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 Sep 03 13:45:46 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (de7d92b0-98a8-4a5c-98b8-ad8e1fd5d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab28039f-d0cf-48ab-b34e-81dba7e1106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab28039f-d0cf-48ab-b34e-81dba7e1106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296590400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df9055d-c581-4029-991d-311481984bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50c8af2-bb29-44b8-890c-813099de87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50c8af2-bb29-44b8-890c-813099de87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9c9da-9fed-4123-b651-d0849645ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9c9da-9fed-4123-b651-d0849645ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df9055d-c581-4029-991d-311481984bad', 'volume_name': 'volume-8df9055d-c581-4029-991d-311481984bad', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eeecfa-5543-4b44-b41a-7662a9481f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eeecfa-5543-4b44-b41a-7662a9481f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250d45b6-32f7-43bb-9e6f-1067c3cc1fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume 8df9055d-c581-4029-991d-311481984bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df9055d-c581-4029-991d-311481984bad', 'volume_size': 1} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:46 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548" returned: 0 in 0.364s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771812097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d25e07-e863-4156-8134-ec5de8327ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume f4d25e07-e863-4156-8134-ec5de8327ee9 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7318f5f-ebbc-4b0c-adb3-98118568262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e3cebf-5c86-400a-9db5-883348bcf548', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ee4824-6c6f-4b5a-8d17-5692db890aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 1073741824 Sep 03 13:45:46 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-21e3cebf-5c86-400a-9db5-883348bcf548 (21e3cebf-5c86-400a-9db5-883348bcf548): created successfully Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ee4824-6c6f-4b5a-8d17-5692db890aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (5eb583cc-f570-49b3-8c56-c74a5a9aaa39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-796b6640-af35-4a46-9455-5a9f9155aec3 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (22c873ee-02a0-4578-a0e2-a791b9355139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7252866b-32df-486c-86ad-e4e4afd5bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7252866b-32df-486c-86ad-e4e4afd5bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233196622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8159de9-5eb1-42c9-ab0f-e5715bd4307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:47Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be33342-1928-4cab-836d-6fa3a420c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be33342-1928-4cab-836d-6fa3a420c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423cfcf7-12d7-4376-83d0-1c23524275c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423cfcf7-12d7-4376-83d0-1c23524275c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8159de9-5eb1-42c9-ab0f-e5715bd4307c', 'volume_name': 'volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28977a79-cc5b-4fec-85a2-86701c60044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28977a79-cc5b-4fec-85a2-86701c60044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85c12b6-3289-4e38-9559-6e2e799e96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:46 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume d8159de9-5eb1-42c9-ab0f-e5715bd4307c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c', 'volume_size': 1} Sep 03 13:45:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (b4992b82-5817-4f1d-80d9-61a9dffc060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6871df-cc10-44c0-ad7c-e97c1f096a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6871df-cc10-44c0-ad7c-e97c1f096a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984745566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a850af0-1cdc-416b-bdbd-4a5a39feb03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:47Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5467996-cd17-4c20-a29c-a92447cd231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5467996-cd17-4c20-a29c-a92447cd231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7eccf7-2fc4-4d64-b635-665095f878b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7eccf7-2fc4-4d64-b635-665095f878b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a850af0-1cdc-416b-bdbd-4a5a39feb03e', 'volume_name': 'volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27901ea6-d96b-4146-8e49-519a013224ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27901ea6-d96b-4146-8e49-519a013224ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced7337-653e-43e8-b8eb-2485feeb7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume 8a850af0-1cdc-416b-bdbd-4a5a39feb03e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e', 'volume_size': 1} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 1073741824" returned: 0 in 0.602s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:47 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 Sep 03 13:45:47 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:47 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296590400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df9055d-c581-4029-991d-311481984bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:46Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume 8df9055d-c581-4029-991d-311481984bad {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:47 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727e91b8-b49f-4d08-84c6-ccfa668e96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d25e07-e863-4156-8134-ec5de8327ee9', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad 1073741824 Sep 03 13:45:47 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8484b4-2054-4bcb-95a4-134c0f303ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-f4d25e07-e863-4156-8134-ec5de8327ee9 (f4d25e07-e863-4156-8134-ec5de8327ee9): created successfully Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8484b4-2054-4bcb-95a4-134c0f303ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (5e923284-f2e1-4c4d-bdad-1896b517095d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ba914810-fbfd-4852-9984-099c2dc475f2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:48 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad 1073741824" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:48 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad Sep 03 13:45:48 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:48 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233196622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8159de9-5eb1-42c9-ab0f-e5715bd4307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:47Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume d8159de9-5eb1-42c9-ab0f-e5715bd4307c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:48 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250d45b6-32f7-43bb-9e6f-1067c3cc1fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df9055d-c581-4029-991d-311481984bad', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:48 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c 1073741824 Sep 03 13:45:48 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8020975f-22f1-4911-ab28-d283f515d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-8df9055d-c581-4029-991d-311481984bad (8df9055d-c581-4029-991d-311481984bad): created successfully Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8020975f-22f1-4911-ab28-d283f515d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (de7d92b0-98a8-4a5c-98b8-ad8e1fd5d310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-677f87b4-a0b3-4de8-ac02-43205ed045b8 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:48 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c 1073741824" returned: 0 in 0.441s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:48 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c Sep 03 13:45:48 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:49 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" returned: 0 in 0.322s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984745566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a850af0-1cdc-416b-bdbd-4a5a39feb03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14761334664e4db7b7b5eee874e9a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:45:47Z,use_quota=True,user_id='2528c600a0ea4a6ea1467184feb8db24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Creating volume 8a850af0-1cdc-416b-bdbd-4a5a39feb03e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:45:49 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85c12b6-3289-4e38-9559-6e2e799e96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2cc074-75e0-47f8-bb16-a73a86c8ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:49 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e 1073741824 Sep 03 13:45:49 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c (d8159de9-5eb1-42c9-ab0f-e5715bd4307c): created successfully Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2cc074-75e0-47f8-bb16-a73a86c8ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (22c873ee-02a0-4578-a0e2-a791b9355139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e35b44ad-ed26-4cc4-a4e8-6bd9f29aa42d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:49 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e 1073741824" returned: 0 in 0.531s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:49 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e Sep 03 13:45:49 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:50 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced7337-653e-43e8-b8eb-2485feeb7b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d576007-b291-4ccf-b0d5-7eb7942a1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:45:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Volume volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e (8a850af0-1cdc-416b-bdbd-4a5a39feb03e): created successfully Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d576007-b291-4ccf-b0d5-7eb7942a1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Flow 'volume_create_manager' (b4992b82-5817-4f1d-80d9-61a9dffc060d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:45:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a6caaa28-571c-423c-a99e-f425e9d154aa tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created volume successfully. Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-8a850af0-1cdc-416b-bdbd-4a5a39feb03e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-8a850af0-1cdc-416b-bdbd-4a5a39feb03e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb9785-e902-411f-a992-5116175c4b07]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:51 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e Sep 03 13:45:51 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:51 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" returned: 0 in 0.401s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:51 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e Sep 03 13:45:51 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:51 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-8a850af0-1cdc-416b-bdbd-4a5a39feb03e" released by "delete_volume" :: held 0.732s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['691d57ef-c5a9-4aaf-8651-7fa47041f81a', 'dc9d7a54-c1f7-4c0c-95b2-84f7d50b14aa', '585645cf-1bdf-46fe-adca-773b18d0ad1d', '82f97ca9-1275-44cf-8128-a2c0eac2ec06'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:51 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:51 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-d8159de9-5eb1-42c9-ab0f-e5715bd4307c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:51 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-d8159de9-5eb1-42c9-ab0f-e5715bd4307c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:51 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-dde94ef9-8636-4bcc-a384-b0ef001f0970 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-8a850af0-1cdc-416b-bdbd-4a5a39feb03e-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8bd18-ae4e-4b83-a166-4422bbd5cd68]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:52 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c Sep 03 13:45:52 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:52 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" returned: 0 in 0.365s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:52 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c Sep 03 13:45:52 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:52 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" returned: 0 in 0.243s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-d8159de9-5eb1-42c9-ab0f-e5715bd4307c" released by "delete_volume" :: held 0.647s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['147840e1-fe9e-4883-a2de-0db462462c63', 'ca6670a4-2ea9-4eba-a553-13e6f24bd151', '520b19e6-9bd1-4788-851a-8f1b5aeb66eb', 'd6c6881b-c2ff-43cc-9177-c19f649ee691'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:52 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:52 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:53 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.245s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-67b8dc50-dfb2-4ebe-99f0-5f8427767cc2 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-d8159de9-5eb1-42c9-ab0f-e5715bd4307c-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-8df9055d-c581-4029-991d-311481984bad-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-8df9055d-c581-4029-991d-311481984bad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-8df9055d-c581-4029-991d-311481984bad" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-8df9055d-c581-4029-991d-311481984bad" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b315c8a-01f4-4035-a41e-342c4548b531]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:53 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad Sep 03 13:45:53 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:53 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad" returned: 0 in 0.379s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:53 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad Sep 03 13:45:53 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:53 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8df9055d-c581-4029-991d-311481984bad" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-8df9055d-c581-4029-991d-311481984bad" released by "delete_volume" :: held 0.707s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['18c6c045-397d-4d41-97d2-79597d0f6f3f', '3c7b4bdb-bafa-4965-8862-ab9570ce36a8', '993a1c45-0fd2-4be0-b39b-a06921835859', '70f370c5-7fee-4a50-9540-87af4c017235'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:54 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:54 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-f4d25e07-e863-4156-8134-ec5de8327ee9-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:54 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-f4d25e07-e863-4156-8134-ec5de8327ee9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-61f051c4-a144-4201-a166-2f16f8bea14d tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-8df9055d-c581-4029-991d-311481984bad-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-f4d25e07-e863-4156-8134-ec5de8327ee9" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-f4d25e07-e863-4156-8134-ec5de8327ee9" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[244af66f-4f39-435f-8f9f-c271d8fb94cb]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:54 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 Sep 03 13:45:54 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:54 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:54 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9 Sep 03 13:45:54 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:55 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f4d25e07-e863-4156-8134-ec5de8327ee9" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-f4d25e07-e863-4156-8134-ec5de8327ee9" released by "delete_volume" :: held 0.677s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['6b40efa3-d585-4bf1-b18f-cca374c828c4', '8fac59a5-d98d-49ba-817b-7fb58670359e', '552974c0-ae81-43ee-9d01-6e44c645d0f5', '5848533e-7332-47db-9e49-4a2ff9830b49'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:55 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:55 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:55 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=274,cinder:INSERT=72,cinder:SELECT=196,cinder:DELETE=28 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-21e3cebf-5c86-400a-9db5-883348bcf548-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-da34f276-5e1a-46cf-bb24-c4859926d211 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-f4d25e07-e863-4156-8134-ec5de8327ee9-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-21e3cebf-5c86-400a-9db5-883348bcf548-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:DELETE=20,cinder:SELECT=198,cinder:UPDATE=270,cinder:INSERT=79 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-21e3cebf-5c86-400a-9db5-883348bcf548" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-21e3cebf-5c86-400a-9db5-883348bcf548" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c7294-a6de-49bb-9de9-d7b451f81b8c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:55 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 Sep 03 13:45:55 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:56 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548" returned: 0 in 0.374s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:56 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548 Sep 03 13:45:56 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:56 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-21e3cebf-5c86-400a-9db5-883348bcf548" returned: 0 in 0.244s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-21e3cebf-5c86-400a-9db5-883348bcf548" released by "delete_volume" :: held 0.660s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['67d1d78d-af3e-4fea-b37f-f4a46581b995', 'c9fc5f38-7f39-4bf7-b546-36904cdcebc4', '2421b3a0-ec5c-401f-9a14-18d40d4d0633', '7c7de929-8789-4f98-85a4-2a8fd90c44c5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:56 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:56 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:56 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:56 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8e0a1346-bb44-43cd-a88e-f48c960769e1 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-21e3cebf-5c86-400a-9db5-883348bcf548-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-2c50e109-7a56-499b-87fd-423aad09dcb8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-2c50e109-7a56-499b-87fd-423aad09dcb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "cinder-quobyte-2c50e109-7a56-499b-87fd-423aad09dcb8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-2c50e109-7a56-499b-87fd-423aad09dcb8" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaeb764-ee22-4238-8d81-dd6553ebc16e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:45:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:56 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 Sep 03 13:45:56 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:57 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:57 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8 Sep 03 13:45:57 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:57 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2c50e109-7a56-499b-87fd-423aad09dcb8" returned: 0 in 0.262s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-quobyte-2c50e109-7a56-499b-87fd-423aad09dcb8" released by "delete_volume" :: held 0.680s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Created reservations ['7c94c58e-351b-4bd6-9c1f-c39fdea2dae5', '059edbd0-2e6b-44d2-93b6-86b0e596bbd0', '43145d61-b324-4502-b764-765918f707ba', 'dcbbf050-5e81-4fd2-9a3e-d37611d8e16a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:45:57 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:45:57 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:45:57 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:45:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Deleted volume successfully. Sep 03 13:45:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-25edaa39-761a-40c8-ba6b-26ea2e80b150 tempest-CreateVolumesFromSourceVolumeTest-276591706 None] Lock "cinder-2c50e109-7a56-499b-87fd-423aad09dcb8-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Flow 'volume_create_manager' (d730d48a-bb90-4164-a0e0-dcfe1ad498d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250f8232-1bf3-4c58-a54f-7c487cebc389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250f8232-1bf3-4c58-a54f-7c487cebc389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617f19be-b604-46b3-b22e-70696544406a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c363cf8f1c940969fea0e6d018e150b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:04Z,use_quota=True,user_id='d8733b6e87d744878ebbaaff0a6899ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf53536-0ce1-4beb-92fc-9d323317e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf53536-0ce1-4beb-92fc-9d323317e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b2c88a-45db-4922-9118-6005e2498477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b2c88a-45db-4922-9118-6005e2498477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '617f19be-b604-46b3-b22e-70696544406a', 'volume_name': 'volume-617f19be-b604-46b3-b22e-70696544406a', 'volume_size': 1, 'image_id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b5474f75aafba1c387de36451ab4779', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c363cf8f1c940969fea0e6d018e150b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf0f96d38d465fd8aaeabffbc01ec243f1e34acfd41c1f4cd60f5b17ac797751de291f06ff9f96d1778c5fe7918f4c44eb5a5918071387922de79c98ae2057f5', 'id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'created_at': datetime.datetime(2026, 9, 3, 11, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 46, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2ec6d7-4c83-42f6-997c-c834d6440806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2ec6d7-4c83-42f6-997c-c834d6440806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e58273-1610-4129-a5c9-658d1793d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Volume 617f19be-b604-46b3-b22e-70696544406a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-617f19be-b604-46b3-b22e-70696544406a', 'volume_size': 1, 'image_id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b5474f75aafba1c387de36451ab4779', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c363cf8f1c940969fea0e6d018e150b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf0f96d38d465fd8aaeabffbc01ec243f1e34acfd41c1f4cd60f5b17ac797751de291f06ff9f96d1778c5fe7918f4c44eb5a5918071387922de79c98ae2057f5', 'id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'created_at': datetime.datetime(2026, 9, 3, 11, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 46, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea/file', 'properties': {}}, 'image_service': } Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Trying to clone 617f19be-b604-46b3-b22e-70696544406a from image ea32b62c-046f-44a4-9b98-b619b9fd26ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:46:04 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Image download 0.00 MB at 0.00 MB/s Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[988844f7-2fff-4681-b1ed-4393ae5dfd5c]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:04 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:04 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:05 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:05 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:05 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:05 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Temporary image ea32b62c-046f-44a4-9b98-b619b9fd26ea is fetched for user d8733b6e87d744878ebbaaff0a6899ad. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df68d4-b4f1-4963-a1b6-c24216c11a58]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:05 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:05 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:05 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:06 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:06 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Flow 'volume_create_manager' (6ad61a4e-d57c-4d39-b9f4-ff4dfd44a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d1e06-3d51-4b8f-a79d-79421a0ee549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d1e06-3d51-4b8f-a79d-79421a0ee549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108526362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24cad8-22c2-45f5-844f-63c536554c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85501b0ae7741f4a56aa2c317ea3365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:06Z,use_quota=True,user_id='e7b86a121d0c4f5db822955d0808c75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c37ac-0987-4247-89b6-3bb27e8475f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c37ac-0987-4247-89b6-3bb27e8475f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397f68b7-c076-418b-9ebd-e764a5a3a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397f68b7-c076-418b-9ebd-e764a5a3a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d24cad8-22c2-45f5-844f-63c536554c8d', 'volume_name': 'volume-6d24cad8-22c2-45f5-844f-63c536554c8d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ad4db2-5f34-425d-99fb-747324840989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ad4db2-5f34-425d-99fb-747324840989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977b889-439a-41bc-bdcb-19825855e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Volume 6d24cad8-22c2-45f5-844f-63c536554c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d24cad8-22c2-45f5-844f-63c536554c8d', 'volume_size': 1} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108526362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24cad8-22c2-45f5-844f-63c536554c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85501b0ae7741f4a56aa2c317ea3365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:06Z,use_quota=True,user_id='e7b86a121d0c4f5db822955d0808c75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Creating volume 6d24cad8-22c2-45f5-844f-63c536554c8d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:46:06 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:06 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d 1073741824 Sep 03 13:46:06 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:06 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:06 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d 1073741824" returned: 0 in 0.414s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:06 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d Sep 03 13:46:06 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:06 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617f19be-b604-46b3-b22e-70696544406a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c363cf8f1c940969fea0e6d018e150b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:04Z,use_quota=True,user_id='d8733b6e87d744878ebbaaff0a6899ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Creating volume 617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:46:07 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977b889-439a-41bc-bdcb-19825855e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d24cad8-22c2-45f5-844f-63c536554c8d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9353520-1af2-4e81-9522-7ead4da6d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:07 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1073741824 Sep 03 13:46:07 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:07 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Volume volume-6d24cad8-22c2-45f5-844f-63c536554c8d (6d24cad8-22c2-45f5-844f-63c536554c8d): created successfully Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9353520-1af2-4e81-9522-7ead4da6d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Flow 'volume_create_manager' (6ad61a4e-d57c-4d39-b9f4-ff4dfd44a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-12ccb6ec-417b-46b7-b2ec-3b51ed82f68d tempest-TestMinimumBasicScenario-1976957882 None] Created volume successfully. Sep 03 13:46:07 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1073741824" returned: 0 in 0.560s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:07 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a Sep 03 13:46:07 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:07 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Attempting download of ea32b62c-046f-44a4-9b98-b619b9fd26ea ((None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}])) to volume 617f19be-b604-46b3-b22e-70696544406a. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a88f6-417b-4d01-be98-775074fc22a4]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-aeab74ce-f58b-4af4-b012-07c0a7f053bc req-6a936238-e944-4e0b-9b18-570043a9e6a3 tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-aeab74ce-f58b-4af4-b012-07c0a7f053bc req-6a936238-e944-4e0b-9b18-570043a9e6a3 tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-aeab74ce-f58b-4af4-b012-07c0a7f053bc req-6a936238-e944-4e0b-9b18-570043a9e6a3 tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:08 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka Sep 03 13:46:08 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-aeab74ce-f58b-4af4-b012-07c0a7f053bc req-6a936238-e944-4e0b-9b18-570043a9e6a3 tempest-TestMinimumBasicScenario-1976957882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-6d24cad8-22c2-45f5-844f-63c536554c8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '108b9c36-558a-4988-b491-299d2b5afa1c', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:46:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-aeab74ce-f58b-4af4-b012-07c0a7f053bc req-6a936238-e944-4e0b-9b18-570043a9e6a3 tempest-TestMinimumBasicScenario-1976957882 None] attachment_update completed successfully. Sep 03 13:46:08 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka" returned: 0 in 0.364s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:08 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka Sep 03 13:46:08 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:08 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka" returned: 1 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea32b62c-046f-44a4-9b98-b619b9fd26ea_mi1xx3ka' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512e7f4-a032-43fb-9feb-7ca56ac5644b]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:08 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:08 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:09 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:09 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD Sep 03 13:46:09 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:09 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] ea32b62c-046f-44a4-9b98-b619b9fd26ea was raw, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:09 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a Sep 03 13:46:09 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:09 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea32b62c-046f-44a4-9b98-b619b9fd26ea_4cxl4ixfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:46:09 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 13:46:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:09 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1G Sep 03 13:46:09 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:10 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a 1G" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Downloaded image ea32b62c-046f-44a4-9b98-b619b9fd26ea ((None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}])) to volume 617f19be-b604-46b3-b22e-70696544406a successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Temporary image ea32b62c-046f-44a4-9b98-b619b9fd26ea for user d8733b6e87d744878ebbaaff0a6899ad is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Marking volume 617f19be-b604-46b3-b22e-70696544406a as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Copying metadata from image ea32b62c-046f-44a4-9b98-b619b9fd26ea to 617f19be-b604-46b3-b22e-70696544406a. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Creating volume glance metadata for volume 617f19be-b604-46b3-b22e-70696544406a backed by image ea32b62c-046f-44a4-9b98-b619b9fd26ea with: {'image_id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8b5474f75aafba1c387de36451ab4779', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e58273-1610-4129-a5c9-658d1793d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617f19be-b604-46b3-b22e-70696544406a', 'volume_size': 1, 'image_id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b5474f75aafba1c387de36451ab4779', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c363cf8f1c940969fea0e6d018e150b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf0f96d38d465fd8aaeabffbc01ec243f1e34acfd41c1f4cd60f5b17ac797751de291f06ff9f96d1778c5fe7918f4c44eb5a5918071387922de79c98ae2057f5', 'id': 'ea32b62c-046f-44a4-9b98-b619b9fd26ea', 'created_at': datetime.datetime(2026, 9, 3, 11, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 46, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea32b62c-046f-44a4-9b98-b619b9fd26ea/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28226c5c-8024-45b4-956c-ee45afd0d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Volume volume-617f19be-b604-46b3-b22e-70696544406a (617f19be-b604-46b3-b22e-70696544406a): created successfully Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28226c5c-8024-45b4-956c-ee45afd0d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Flow 'volume_create_manager' (d730d48a-bb90-4164-a0e0-dcfe1ad498d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9dae153e-cd86-496f-b292-f1073ed5233f tempest-VolumeImageDependencyTests-1466912203 None] Created volume successfully. Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Acquiring lock "cinder-617f19be-b604-46b3-b22e-70696544406a-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "cinder-617f19be-b604-46b3-b22e-70696544406a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Acquiring lock "cinder-quobyte-617f19be-b604-46b3-b22e-70696544406a" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "cinder-quobyte-617f19be-b604-46b3-b22e-70696544406a" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c25bf5-f07a-4b37-9c1f-2649d8380546]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:10 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a Sep 03 13:46:10 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:11 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a" returned: 0 in 0.370s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:11 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a Sep 03 13:46:11 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:11 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-617f19be-b604-46b3-b22e-70696544406a" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "cinder-quobyte-617f19be-b604-46b3-b22e-70696544406a" released by "delete_volume" :: held 0.690s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Created reservations ['6f9e2ca9-4aa9-49b6-b20f-2f0238b46e94', 'bc2b3193-8143-4b1e-ab00-2e073616ab57', '8d6fe7a7-12d9-4a36-aa24-2acfd3521c53', '5e1f7915-566e-4fa5-bcc6-f28e27f027f5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:11 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:46:11 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:11 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:46:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Deleted volume successfully. Sep 03 13:46:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-92575f61-2ec9-4696-b63a-1ad94d9d0816 tempest-VolumeImageDependencyTests-1466912203 None] Lock "cinder-617f19be-b604-46b3-b22e-70696544406a-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:46:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:46:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=32,cinder:INSERT=13,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:33 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:46:33 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:33 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.319s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:46:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:46:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:46:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Flow 'volume_create_manager' (65508038-b227-428f-8141-768cef532a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b820f-a3e5-4d47-a8d3-729c5537c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b820f-a3e5-4d47-a8d3-729c5537c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2063222125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d79c647-5a4c-44ef-a337-96c7b2a3c403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea712a60bd814a1c9bbc09be2efbe4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:50Z,use_quota=True,user_id='f4382c10052a42f98d1d1e2c230ec34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314bf2b9-bb16-4b45-8d5e-a03a41ce5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314bf2b9-bb16-4b45-8d5e-a03a41ce5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ed902e-d929-4c6f-aa4c-97864555f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ed902e-d929-4c6f-aa4c-97864555f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d79c647-5a4c-44ef-a337-96c7b2a3c403', 'volume_name': 'volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d6884-7bff-4cf0-a962-6ea73df93839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d6884-7bff-4cf0-a962-6ea73df93839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f5d819-f733-41b6-9bc9-cc5506f572f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Volume 7d79c647-5a4c-44ef-a337-96c7b2a3c403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403', 'volume_size': 1} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2063222125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d79c647-5a4c-44ef-a337-96c7b2a3c403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea712a60bd814a1c9bbc09be2efbe4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:50Z,use_quota=True,user_id='f4382c10052a42f98d1d1e2c230ec34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Creating volume 7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:46:49 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:46:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:49 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 1073741824 Sep 03 13:46:49 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:50 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 1073741824" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:50 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:46:50 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:50 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f5d819-f733-41b6-9bc9-cc5506f572f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fcb631-deb4-4a52-89bf-d7dd709443b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Volume volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 (7d79c647-5a4c-44ef-a337-96c7b2a3c403): created successfully Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fcb631-deb4-4a52-89bf-d7dd709443b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Flow 'volume_create_manager' (65508038-b227-428f-8141-768cef532a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7cde0e2d-0e22-4c04-a04b-66a8a09454d9 tempest-SnapshotDependencyTests-1667224898 None] Created volume successfully. Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Creating offline snapshot 8cc99c22-4b20-4bd2-aecc-2b562432c1e4 of volume 7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dea0250-3d4c-4343-b705-b7c979195831]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:51 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:46:51 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:51 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.379s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:51 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 1G Sep 03 13:46:51 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:51 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 1G" returned: 0 in 0.401s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:51 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:46:51 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:52 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:52 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 is being set with open permissions: ugo+rw Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:52 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:46:52 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:52 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:52 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info Sep 03 13:46:52 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:52 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info" returned: 0 in 0.274s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:52 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info is being set with open permissions: ugo+rw Sep 03 13:46:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:52 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info Sep 03 13:46:52 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:53 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.info" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f465f6c3-aef1-418b-93d2-ceaf50f995c4 tempest-SnapshotDependencyTests-1667224898 None] Create snapshot completed successfully Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Flow 'volume_create_manager' (5ff7d27b-6b33-4d00-aeea-10790b49ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6960ec78-f2cf-4d18-a9ae-968e9fec2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6960ec78-f2cf-4d18-a9ae-968e9fec2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0247c4-00bd-414c-a758-b7a2c0245984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea712a60bd814a1c9bbc09be2efbe4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cc99c22-4b20-4bd2-aecc-2b562432c1e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:46:54Z,use_quota=True,user_id='f4382c10052a42f98d1d1e2c230ec34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71009061-5b68-4245-9c9c-b6197c623f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71009061-5b68-4245-9c9c-b6197c623f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c307ba3-8d44-4db1-a2e4-76b1a92f2d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c307ba3-8d44-4db1-a2e4-76b1a92f2d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d0247c4-00bd-414c-a758-b7a2c0245984', 'volume_name': 'volume-7d0247c4-00bd-414c-a758-b7a2c0245984', 'volume_size': 1, 'snapshot_id': '8cc99c22-4b20-4bd2-aecc-2b562432c1e4'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7dc02e-71bc-4e8a-a40a-6df27c839b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7dc02e-71bc-4e8a-a40a-6df27c839b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2dac6e-40f9-432d-a741-e07a7b74ec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:46:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Volume 7d0247c4-00bd-414c-a758-b7a2c0245984: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d0247c4-00bd-414c-a758-b7a2c0245984', 'volume_size': 1, 'snapshot_id': '8cc99c22-4b20-4bd2-aecc-2b562432c1e4'} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-7d0247c4-00bd-414c-a758-b7a2c0245984" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-7d0247c4-00bd-414c-a758-b7a2c0245984" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Creating volume 7d0247c4-00bd-414c-a758-b7a2c0245984 from snapshot 8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] snapshot: 8cc99c22-4b20-4bd2-aecc-2b562432c1e4, volume: 7d0247c4-00bd-414c-a758-b7a2c0245984, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c81eac-f01d-4246-9d68-de77afa359d9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:54 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:46:54 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:55 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.379s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b2d833-2010-4bcc-a2be-4fb3e0f26d56]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:55 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:46:55 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:55 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.398s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:55 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 Sep 03 13:46:55 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-8cd3fe2e-2e87-45ff-a34a-8017c9fcd11e req-bf9aed02-f90c-4961-9c2a-96b58045d59f tempest-TestMinimumBasicScenario-1976957882 None] Terminate volume connection completed successfully. Sep 03 13:46:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-8cd3fe2e-2e87-45ff-a34a-8017c9fcd11e req-bf9aed02-f90c-4961-9c2a-96b58045d59f tempest-TestMinimumBasicScenario-1976957882 None] Deleting attachment 108b9c36-558a-4988-b491-299d2b5afa1c. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "cinder-6d24cad8-22c2-45f5-844f-63c536554c8d-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "cinder-6d24cad8-22c2-45f5-844f-63c536554c8d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "cinder-quobyte-6d24cad8-22c2-45f5-844f-63c536554c8d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "cinder-quobyte-6d24cad8-22c2-45f5-844f-63c536554c8d" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[98220bf9-948b-444c-9d1f-83b4585ef6af]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:46:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:57 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d Sep 03 13:46:57 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:58 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d" returned: 0 in 0.657s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:58 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d Sep 03 13:46:58 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:58 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-6d24cad8-22c2-45f5-844f-63c536554c8d" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "cinder-quobyte-6d24cad8-22c2-45f5-844f-63c536554c8d" released by "delete_volume" :: held 1.154s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:46:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Created reservations ['2837112d-9736-4cbc-9bbc-363ebf195ad5', '6f5577a0-f8a1-4abb-90d5-98e5aaa8b56d', 'b21a81cb-ad27-404c-ac8d-c678ff3d2ca9', 'aa748f01-dc6a-4e35-912b-4188a2a271a7'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:46:59 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:46:59 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:46:59 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:46:59 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Deleted volume successfully. Sep 03 13:46:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0152bafa-b134-4f4d-b4e6-e8764bb2e491 tempest-TestMinimumBasicScenario-1976957882 None] Lock "cinder-6d24cad8-22c2-45f5-844f-63c536554c8d-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:00 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984" returned: 0 in 4.814s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:47:00 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Converted 1024.00 MB image at 212.65 MB/s Sep 03 13:47:00 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 is being set with open permissions: ugo+rw Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:00 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 Sep 03 13:47:00 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:00 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" released by "_copy_volume_from_snapshot" :: held 6.054s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-7d0247c4-00bd-414c-a758-b7a2c0245984" released by "_create_volume_from_snapshot" :: held 6.132s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.152s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2dac6e-40f9-432d-a741-e07a7b74ec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0247c4-00bd-414c-a758-b7a2c0245984', 'volume_size': 1, 'snapshot_id': '8cc99c22-4b20-4bd2-aecc-2b562432c1e4'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40eca4f-db63-4666-8eb1-48707be32334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:00 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Volume volume-7d0247c4-00bd-414c-a758-b7a2c0245984 (7d0247c4-00bd-414c-a758-b7a2c0245984): created successfully Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40eca4f-db63-4666-8eb1-48707be32334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Flow 'volume_create_manager' (5ff7d27b-6b33-4d00-aeea-10790b49ad66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:47:00 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6111a0f4-0fe5-45e0-9c85-c24753bcd99a tempest-SnapshotDependencyTests-1667224898 None] Created volume successfully. Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Deleting offline snapshot 8cc99c22-4b20-4bd2-aecc-2b562432c1e4 of volume 7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] snapshot_file for this snap is: volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68463e0a-bf61-44e6-bb67-9b02cdb24d4b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:01 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:47:01 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:01 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.395s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4473aa-87a1-422e-a923-05c596a3b16c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:47:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:01 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:47:01 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:02 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.605s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:02 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:47:02 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:02 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:02 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4 Sep 03 13:47:02 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:02 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403.8cc99c22-4b20-4bd2-aecc-2b562432c1e4" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-8cc99c22-4b20-4bd2-aecc-2b562432c1e4" released by "_delete_snapshot" :: held 1.750s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" released by "delete_snapshot" :: held 1.773s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Created reservations ['1b690428-322c-48c4-9942-e996af84d55c', '9abd2b53-2757-48cf-9d43-a4a8a474a659', 'b854745e-988b-47ed-9124-cc97c7f38200', '921d54a7-3f64-4444-aec1-7230243c8eeb'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:47:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Delete snapshot completed successfully. Sep 03 13:47:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f296549-020c-459b-a102-a0cbacdc2273 tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-8cc99c22-4b20-4bd2-aecc-2b562432c1e4-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-7d79c647-5a4c-44ef-a337-96c7b2a3c403-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-7d79c647-5a4c-44ef-a337-96c7b2a3c403-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3311d2-ca78-41eb-aeb0-7e1c4ae2df76]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:03 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:47:03 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:03 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:03 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403 Sep 03 13:47:03 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:03 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d79c647-5a4c-44ef-a337-96c7b2a3c403" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d79c647-5a4c-44ef-a337-96c7b2a3c403" released by "delete_volume" :: held 0.730s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Created reservations ['281569e2-55d8-4720-aca0-bef117c15a46', '49a5233c-13f3-47c6-b254-17d0054d183a', '95ccacba-6594-4a44-9a61-688ebb5f37dd', '9b37b515-ba61-45fa-a6c2-d165c495d074'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:04 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:47:04 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:04 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-7d0247c4-00bd-414c-a758-b7a2c0245984-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.310s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:47:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Deleted volume successfully. Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-7d0247c4-00bd-414c-a758-b7a2c0245984-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0a7303ab-03a1-487f-b716-ab463124c42e tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-7d79c647-5a4c-44ef-a337-96c7b2a3c403-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" acquired by "delete_volume" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabeedd5-c86b-48d2-ad7e-4c42dc7e2c41]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:04 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 Sep 03 13:47:04 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:04 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984" returned: 0 in 0.361s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:04 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984 Sep 03 13:47:04 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:05 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7d0247c4-00bd-414c-a758-b7a2c0245984" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-quobyte-7d0247c4-00bd-414c-a758-b7a2c0245984" released by "delete_volume" :: held 0.663s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Created reservations ['a22be279-9ade-48ff-bd41-2dcd3d1fcbdf', '3d7336ce-9f54-4620-bdea-086b8a0c51e0', 'a554dbf6-85fc-4cdc-af7d-19f80067e028', 'd8155f3a-e7b7-4d08-a350-fde3389731fc'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:05 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:47:05 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:05 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:47:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Deleted volume successfully. Sep 03 13:47:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-45baf1fd-b243-42d8-ad49-4e747e66671a tempest-SnapshotDependencyTests-1667224898 None] Lock "cinder-7d0247c4-00bd-414c-a758-b7a2c0245984-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:47:15 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=34,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:47:15 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=27,cinder:UPDATE=39,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:33 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:47:33 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:33 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:47:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Flow 'volume_create_manager' (cf4597dd-b6a8-4719-b3bb-b82b02b76b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f780ab-aafb-4703-b4d7-6d87dca5b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f780ab-aafb-4703-b4d7-6d87dca5b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-531780423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9677b9b8-8d22-4fdb-b045-4ba74deae5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19dcd55f634462795add26f5581d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:47:34Z,use_quota=True,user_id='468b643c63a6420f94424ee9fc002f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac89f21-e77b-45f8-801a-8407b27ce8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac89f21-e77b-45f8-801a-8407b27ce8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef19acb3-f771-4c67-9533-dcc98af4fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef19acb3-f771-4c67-9533-dcc98af4fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9677b9b8-8d22-4fdb-b045-4ba74deae5b4', 'volume_name': 'volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6be885-2c7d-4322-85c3-d81cca29a1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6be885-2c7d-4322-85c3-d81cca29a1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a665127-7b06-40db-aa5d-bc715a892fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume 9677b9b8-8d22-4fdb-b045-4ba74deae5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4', 'volume_size': 1} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-531780423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9677b9b8-8d22-4fdb-b045-4ba74deae5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19dcd55f634462795add26f5581d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:47:34Z,use_quota=True,user_id='468b643c63a6420f94424ee9fc002f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Creating volume 9677b9b8-8d22-4fdb-b045-4ba74deae5b4 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:47:34 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:34 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 1073741824 Sep 03 13:47:34 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Flow 'volume_create_manager' (a0186a40-be83-4f81-af40-27eb71a608e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6ddef6-38f1-48b8-a0ff-ed0725318f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6ddef6-38f1-48b8-a0ff-ed0725318f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-43555905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9befd938-63b8-4232-a048-5422cf743a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19dcd55f634462795add26f5581d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:47:34Z,use_quota=True,user_id='468b643c63a6420f94424ee9fc002f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235bf62-7522-48b2-a580-ee38deac2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235bf62-7522-48b2-a580-ee38deac2a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c37ffb1-9a26-4e85-956a-6c940eb956b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c37ffb1-9a26-4e85-956a-6c940eb956b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9befd938-63b8-4232-a048-5422cf743a65', 'volume_name': 'volume-9befd938-63b8-4232-a048-5422cf743a65', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16428ab-f3f3-4732-9c7e-298c398a4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16428ab-f3f3-4732-9c7e-298c398a4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7c2636-50cd-4940-9f8e-2575a4aafd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:34 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume 9befd938-63b8-4232-a048-5422cf743a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9befd938-63b8-4232-a048-5422cf743a65', 'volume_size': 1} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:34 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 1073741824" returned: 0 in 0.565s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:34 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 Sep 03 13:47:34 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:35 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-43555905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9befd938-63b8-4232-a048-5422cf743a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19dcd55f634462795add26f5581d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:47:34Z,use_quota=True,user_id='468b643c63a6420f94424ee9fc002f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Creating volume 9befd938-63b8-4232-a048-5422cf743a65 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:47:35 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a665127-7b06-40db-aa5d-bc715a892fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:35 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 1073741824 Sep 03 13:47:35 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f23669c-28a5-4a84-9ca8-8511c7f74123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:35 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 (9677b9b8-8d22-4fdb-b045-4ba74deae5b4): created successfully Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f23669c-28a5-4a84-9ca8-8511c7f74123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Flow 'volume_create_manager' (cf4597dd-b6a8-4719-b3bb-b82b02b76b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:47:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c7654d8e-86ce-4bdb-833c-d912c4c9cc6a tempest-TestServerVolumeAttachmentScenario-464562767 None] Created volume successfully. Sep 03 13:47:35 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 1073741824" returned: 0 in 0.513s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:47:35 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 Sep 03 13:47:35 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:47:35 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7c2636-50cd-4940-9f8e-2575a4aafd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9befd938-63b8-4232-a048-5422cf743a65', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447e8ac-6468-4d3e-90be-4c274d9f69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:47:35 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Volume volume-9befd938-63b8-4232-a048-5422cf743a65 (9befd938-63b8-4232-a048-5422cf743a65): created successfully Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447e8ac-6468-4d3e-90be-4c274d9f69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:47:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Flow 'volume_create_manager' (a0186a40-be83-4f81-af40-27eb71a608e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:47:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-83d0e500-e170-4857-a7f1-8e8f50780740 tempest-TestServerVolumeAttachmentScenario-464562767 None] Created volume successfully. Sep 03 13:47:45 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:47:45 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:48:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-736968da-c3af-48e0-9d96-950d5740403f req-0737387f-0f01-4367-92c3-cf377361eb7f tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-736968da-c3af-48e0-9d96-950d5740403f req-0737387f-0f01-4367-92c3-cf377361eb7f tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-736968da-c3af-48e0-9d96-950d5740403f req-0737387f-0f01-4367-92c3-cf377361eb7f tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-736968da-c3af-48e0-9d96-950d5740403f req-0737387f-0f01-4367-92c3-cf377361eb7f tempest-TestServerVolumeAttachmentScenario-464562767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cd55771-9188-40ae-83fb-0daed6aceb4e', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:48:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-736968da-c3af-48e0-9d96-950d5740403f req-0737387f-0f01-4367-92c3-cf377361eb7f tempest-TestServerVolumeAttachmentScenario-464562767 None] attachment_update completed successfully. Sep 03 13:48:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-7178e1f0-04f7-402c-875e-e95b8c681375 req-7fd878b3-5875-4512-bb65-ba3ef12518c9 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-7178e1f0-04f7-402c-875e-e95b8c681375 req-7fd878b3-5875-4512-bb65-ba3ef12518c9 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-7178e1f0-04f7-402c-875e-e95b8c681375 req-7fd878b3-5875-4512-bb65-ba3ef12518c9 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-7178e1f0-04f7-402c-875e-e95b8c681375 req-7fd878b3-5875-4512-bb65-ba3ef12518c9 tempest-TestServerVolumeAttachmentScenario-464562767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-9befd938-63b8-4232-a048-5422cf743a65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd167c040-9a6d-480d-85ac-5c498a137b5d', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:48:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-7178e1f0-04f7-402c-875e-e95b8c681375 req-7fd878b3-5875-4512-bb65-ba3ef12518c9 tempest-TestServerVolumeAttachmentScenario-464562767 None] attachment_update completed successfully. Sep 03 13:48:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-a8497c0e-8a93-4410-9ac8-d4da70c09921 req-7b3c8cdf-2cef-4f27-b856-83eebe09a5d2 tempest-TestServerVolumeAttachmentScenario-464562767 None] Terminate volume connection completed successfully. Sep 03 13:48:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-a8497c0e-8a93-4410-9ac8-d4da70c09921 req-7b3c8cdf-2cef-4f27-b856-83eebe09a5d2 tempest-TestServerVolumeAttachmentScenario-464562767 None] Deleting attachment d167c040-9a6d-480d-85ac-5c498a137b5d. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:48:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-85bf9684-606a-4c95-8288-b041c8ee7e17 req-04087ec3-27ff-4594-af27-0b42f85959b6 tempest-TestServerVolumeAttachmentScenario-464562767 None] Terminate volume connection completed successfully. Sep 03 13:48:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-85bf9684-606a-4c95-8288-b041c8ee7e17 req-04087ec3-27ff-4594-af27-0b42f85959b6 tempest-TestServerVolumeAttachmentScenario-464562767 None] Deleting attachment 6cd55771-9188-40ae-83fb-0daed6aceb4e. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "cinder-9befd938-63b8-4232-a048-5422cf743a65-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-9befd938-63b8-4232-a048-5422cf743a65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "cinder-quobyte-9befd938-63b8-4232-a048-5422cf743a65" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-quobyte-9befd938-63b8-4232-a048-5422cf743a65" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859bd31-f015-4ba3-932e-d6cf6e93bf43]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:48:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:17 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 Sep 03 13:48:17 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:17 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:17 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65 Sep 03 13:48:17 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:17 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9befd938-63b8-4232-a048-5422cf743a65" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-quobyte-9befd938-63b8-4232-a048-5422cf743a65" released by "delete_volume" :: held 0.637s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Created reservations ['b3d6e517-fc39-4e71-9563-7719832385df', '1d56ddda-d096-4e19-b97a-e82d6bd6130f', '47d3574e-8469-4efd-98cf-2fd07f134782', '33a4be98-5d71-4223-855d-0fc5c6c2d929'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:17 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:48:17 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:17 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.249s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:48:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Deleted volume successfully. Sep 03 13:48:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a2a4f86-c17f-464e-a4e3-b6e63ab8bf42 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-9befd938-63b8-4232-a048-5422cf743a65-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "cinder-9677b9b8-8d22-4fdb-b045-4ba74deae5b4-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-9677b9b8-8d22-4fdb-b045-4ba74deae5b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "cinder-quobyte-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-quobyte-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" acquired by "delete_volume" :: waited 0.013s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d5803-a441-4556-b379-503ccae19180]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:18 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 Sep 03 13:48:18 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:18 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:18 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4 Sep 03 13:48:18 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:18 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-quobyte-9677b9b8-8d22-4fdb-b045-4ba74deae5b4" released by "delete_volume" :: held 0.633s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Created reservations ['1f2cc451-c883-4618-8252-f5f74e497bac', 'fa6d6396-a8c8-4cc6-9896-f17429b647fb', '8452e88f-b3d5-43f6-a0d8-fe9dbe1d557b', '6e12b341-eb90-4c7b-86ec-4777dd8b5adf'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:18 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:48:18 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:19 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:19 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:48:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Deleted volume successfully. Sep 03 13:48:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e47ba5b-e1a4-4ca8-86a5-a84e0a899656 tempest-TestServerVolumeAttachmentScenario-464562767 None] Lock "cinder-9677b9b8-8d22-4fdb-b045-4ba74deae5b4-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:48:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=28,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:48:29 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:33 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:48:33 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:33 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:48:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Flow 'volume_create_manager' (9725eaca-aa84-46df-a08e-771427745cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5b4218-66bf-41f7-bdb5-b8190338cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5b4218-66bf-41f7-bdb5-b8190338cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1647211161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43452d9-9af1-448e-bdfc-f33de3005163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eba000782034f8d94e2b7b89c33703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:48:49Z,use_quota=True,user_id='9c3eb1c14b8a4c0d9a4396af8292cfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6235854-c7d0-4e09-b655-7864dec16718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6235854-c7d0-4e09-b655-7864dec16718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627db61b-3359-4155-af83-52a28f0fe84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627db61b-3359-4155-af83-52a28f0fe84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43452d9-9af1-448e-bdfc-f33de3005163', 'volume_name': 'volume-d43452d9-9af1-448e-bdfc-f33de3005163', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1a381-4122-4512-8a4e-8eecacd2c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1a381-4122-4512-8a4e-8eecacd2c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746c997f-f4d6-4077-9eb0-1431da50b0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Volume d43452d9-9af1-448e-bdfc-f33de3005163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43452d9-9af1-448e-bdfc-f33de3005163', 'volume_size': 1} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1647211161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43452d9-9af1-448e-bdfc-f33de3005163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eba000782034f8d94e2b7b89c33703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:48:49Z,use_quota=True,user_id='9c3eb1c14b8a4c0d9a4396af8292cfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Creating volume d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:48:49 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:49 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 1073741824 Sep 03 13:48:49 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:49 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 1073741824" returned: 0 in 0.439s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:48:49 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:48:49 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:48:49 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746c997f-f4d6-4077-9eb0-1431da50b0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43452d9-9af1-448e-bdfc-f33de3005163', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754af0c2-5484-4ea6-b652-4dfd5f1fa9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:48:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Volume volume-d43452d9-9af1-448e-bdfc-f33de3005163 (d43452d9-9af1-448e-bdfc-f33de3005163): created successfully Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754af0c2-5484-4ea6-b652-4dfd5f1fa9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:48:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Flow 'volume_create_manager' (9725eaca-aa84-46df-a08e-771427745cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:48:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f9855510-cde9-4dac-8889-abb2acb09fd1 tempest-TestStampPattern-1745185528 None] Created volume successfully. Sep 03 13:48:59 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:48:59 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:49:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-a1446293-b695-4736-9e62-4cf0f1217b0a req-6587f418-2080-4a31-b80b-365342ce846a tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-a1446293-b695-4736-9e62-4cf0f1217b0a req-6587f418-2080-4a31-b80b-365342ce846a tempest-TestStampPattern-1745185528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-a1446293-b695-4736-9e62-4cf0f1217b0a req-6587f418-2080-4a31-b80b-365342ce846a tempest-TestStampPattern-1745185528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-a1446293-b695-4736-9e62-4cf0f1217b0a req-6587f418-2080-4a31-b80b-365342ce846a tempest-TestStampPattern-1745185528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-d43452d9-9af1-448e-bdfc-f33de3005163', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdef71ea-1ae7-4dd9-8b6a-bf09c9071302', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:49:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-a1446293-b695-4736-9e62-4cf0f1217b0a req-6587f418-2080-4a31-b80b-365342ce846a tempest-TestStampPattern-1745185528 None] attachment_update completed successfully. Sep 03 13:49:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-4a325089-c1db-45df-a76e-9ad68c8c0d40 req-ce8122b2-4d19-4239-9b9e-3a8f08b0a7de tempest-TestStampPattern-1745185528 None] Terminate volume connection completed successfully. Sep 03 13:49:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-4a325089-c1db-45df-a76e-9ad68c8c0d40 req-ce8122b2-4d19-4239-9b9e-3a8f08b0a7de tempest-TestStampPattern-1745185528 None] Deleting attachment cdef71ea-1ae7-4dd9-8b6a-bf09c9071302. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:49:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Creating offline snapshot d32458e3-91ea-4f68-b998-3552e29ed903 of volume d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:49:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baa2a30-73e0-4ed4-968d-6695ab3ec766]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:49:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:24 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:49:24 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:24 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:24 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 1G Sep 03 13:49:24 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:24 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 1G" returned: 0 in 0.387s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43452d9-9af1-448e-bdfc-f33de3005163 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:24 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43452d9-9af1-448e-bdfc-f33de3005163 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:49:24 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:24 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43452d9-9af1-448e-bdfc-f33de3005163 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:24 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 is being set with open permissions: ugo+rw Sep 03 13:49:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:24 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:49:24 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:25 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.231s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:25 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info Sep 03 13:49:25 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:25 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:25 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info is being set with open permissions: ugo+rw Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:25 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info Sep 03 13:49:25 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:25 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.info" returned: 0 in 0.231s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-034b4e8c-2cd3-40a4-a69a-26986e402e29 tempest-TestStampPattern-1745185528 None] Create snapshot completed successfully Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Flow 'volume_create_manager' (c1006816-c3df-437a-937a-9e8fd4b24ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa983b-6e2b-4fbd-b432-e63018a3016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa983b-6e2b-4fbd-b432-e63018a3016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-909522324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff20691e-3f5f-4f0a-9176-13cbcfbca0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eba000782034f8d94e2b7b89c33703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d32458e3-91ea-4f68-b998-3552e29ed903,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:49:33Z,use_quota=True,user_id='9c3eb1c14b8a4c0d9a4396af8292cfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7121d4eb-dd76-48f7-aaf5-d4ba17bc9ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7121d4eb-dd76-48f7-aaf5-d4ba17bc9ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8538fc0f-7c1d-49a5-b77d-c85994cb0816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8538fc0f-7c1d-49a5-b77d-c85994cb0816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff20691e-3f5f-4f0a-9176-13cbcfbca0ad', 'volume_name': 'volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad', 'volume_size': 1, 'snapshot_id': 'd32458e3-91ea-4f68-b998-3552e29ed903'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e07e1d-1ef4-4b0b-933e-96cc22e70284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e07e1d-1ef4-4b0b-933e-96cc22e70284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8239d6c-5367-44a5-9484-e53feef6a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:32 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Volume ff20691e-3f5f-4f0a-9176-13cbcfbca0ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad', 'volume_size': 1, 'snapshot_id': 'd32458e3-91ea-4f68-b998-3552e29ed903'} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Creating volume ff20691e-3f5f-4f0a-9176-13cbcfbca0ad from snapshot d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] snapshot: d32458e3-91ea-4f68-b998-3552e29ed903, volume: ff20691e-3f5f-4f0a-9176-13cbcfbca0ad, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41fe7d-fb4d-4533-8c7a-e0e53ba72ba7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:49:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:32 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:49:32 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:33 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d43452d9-9af1-448e-bdfc-f33de3005163(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe777a-da50-474a-873a-5b69ad719088]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:33 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:49:33 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:33 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.403s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:33 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad Sep 03 13:49:33 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:33 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:49:33 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:33 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:49:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:49:39 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" returned: 0 in 6.192s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:39 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:49:39 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Converted 1024.00 MB image at 165.33 MB/s Sep 03 13:49:39 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad is being set with open permissions: ugo+rw Sep 03 13:49:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:49:39 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad Sep 03 13:49:39 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:49:40 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" released by "_copy_volume_from_snapshot" :: held 7.356s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" released by "_create_volume_from_snapshot" :: held 7.424s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.442s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8239d6c-5367-44a5-9484-e53feef6a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad', 'volume_size': 1, 'snapshot_id': 'd32458e3-91ea-4f68-b998-3552e29ed903'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bdefb0-4400-4cee-95dd-bf0a7a8f9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:49:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Volume volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad (ff20691e-3f5f-4f0a-9176-13cbcfbca0ad): created successfully Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bdefb0-4400-4cee-95dd-bf0a7a8f9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:49:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Flow 'volume_create_manager' (c1006816-c3df-437a-937a-9e8fd4b24ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:49:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e5caf356-5628-43dd-8183-9a6ebb2320f9 tempest-TestStampPattern-1745185528 None] Created volume successfully. Sep 03 13:49:50 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:49:50 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:50:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-9a23740b-34de-471d-9a31-f2b94e31aef5 req-006ae421-ee15-43e0-87e2-2bf0177e4e93 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-9a23740b-34de-471d-9a31-f2b94e31aef5 req-006ae421-ee15-43e0-87e2-2bf0177e4e93 tempest-TestStampPattern-1745185528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [req-9a23740b-34de-471d-9a31-f2b94e31aef5 req-006ae421-ee15-43e0-87e2-2bf0177e4e93 tempest-TestStampPattern-1745185528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-9a23740b-34de-471d-9a31-f2b94e31aef5 req-006ae421-ee15-43e0-87e2-2bf0177e4e93 tempest-TestStampPattern-1745185528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c', 'name': 'volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '340c5633-31f7-4343-8948-ea481b070788', 'enforce_multipath': True} {{(pid=86933) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 13:50:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-9a23740b-34de-471d-9a31-f2b94e31aef5 req-006ae421-ee15-43e0-87e2-2bf0177e4e93 tempest-TestStampPattern-1745185528 None] attachment_update completed successfully. Sep 03 13:50:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [req-398dfaf6-2cf6-4efd-85b3-43170f2f05be req-cae2bda2-7fe6-4e37-9508-a744407394a6 tempest-TestStampPattern-1745185528 None] Terminate volume connection completed successfully. Sep 03 13:50:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [req-398dfaf6-2cf6-4efd-85b3-43170f2f05be req-cae2bda2-7fe6-4e37-9508-a744407394a6 tempest-TestStampPattern-1745185528 None] Deleting attachment 340c5633-31f7-4343-8948-ea481b070788. {{(pid=86933) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "cinder-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[226221d9-ad5d-46bf-a8e7-a536bbef8cf0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:28 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad Sep 03 13:50:28 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:29 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" returned: 0 in 0.359s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:29 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad Sep 03 13:50:29 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:29 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" returned: 0 in 0.238s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad" released by "delete_volume" :: held 0.637s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Created reservations ['82994437-7322-4728-922a-ec92f9584e95', 'a6e57e93-fe0f-4711-9630-f8114a2a7ed0', 'fe4a8593-46c4-4549-b6a7-28438922d0ef', 'e47018d8-cfb2-40b9-b7cc-2c7a0a7fe3d4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:29 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:50:29 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:29 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.237s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:50:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Deleted volume successfully. Sep 03 13:50:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9dde3492-693e-4d48-8040-fd2e1b897965 tempest-TestStampPattern-1745185528 None] Lock "cinder-ff20691e-3f5f-4f0a-9176-13cbcfbca0ad-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-d32458e3-91ea-4f68-b998-3552e29ed903-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-d32458e3-91ea-4f68-b998-3552e29ed903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Deleting offline snapshot d32458e3-91ea-4f68-b998-3552e29ed903 of volume d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] snapshot_file for this snap is: volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc3e3e-4f37-43e3-87f5-be29ce805ffc]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:30 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:50:30 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:30 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d43452d9-9af1-448e-bdfc-f33de3005163(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e96384-4799-4897-8d42-183587fdbac6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:30 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:50:30 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:31 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.496s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:31 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:50:31 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:31 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.318s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:31 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903 Sep 03 13:50:31 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:31 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163.d32458e3-91ea-4f68-b998-3552e29ed903" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d32458e3-91ea-4f68-b998-3552e29ed903" released by "_delete_snapshot" :: held 1.489s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" released by "delete_snapshot" :: held 1.513s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Created reservations ['a0a61e27-5375-4871-a51b-e708fda64fdd', '389cb53b-10ff-4fcf-8df4-8da021afe9f0', '1801b1b3-df05-4585-a428-23408bd3c045', '5aed5723-de40-4b16-9667-c20f96f3badb'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:50:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Delete snapshot completed successfully. Sep 03 13:50:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-26b01f80-6a9c-482d-9be7-b6f3ad7f2c94 tempest-TestStampPattern-1745185528 None] Lock "cinder-d32458e3-91ea-4f68-b998-3552e29ed903-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:33 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:50:33 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:33 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:50:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-d43452d9-9af1-448e-bdfc-f33de3005163-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "cinder-d43452d9-9af1-448e-bdfc-f33de3005163-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Acquiring lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[165ed365-d36f-4b69-b051-283d0ccc9b38]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:35 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:50:35 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:36 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.365s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:36 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163 Sep 03 13:50:36 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:36 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-d43452d9-9af1-448e-bdfc-f33de3005163" returned: 0 in 0.236s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "cinder-quobyte-d43452d9-9af1-448e-bdfc-f33de3005163" released by "delete_volume" :: held 0.654s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Created reservations ['7ac72579-3aa4-4509-8b5c-93e663c55b5f', '257f35ba-04cb-4b42-aa27-7747013731e1', '9582506a-e22d-4299-ad76-2255f6474a9f', '73573c23-3703-42b4-ae63-7f4783130b5b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:36 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:50:36 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:36 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.239s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:50:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Deleted volume successfully. Sep 03 13:50:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6ce14643-7ea0-40e8-9d48-b737591cd524 tempest-TestStampPattern-1745185528 None] Lock "cinder-d43452d9-9af1-448e-bdfc-f33de3005163-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:46 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:50:46 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Flow 'volume_create_manager' (fb6e1f84-b732-47eb-a31a-3152a6aaeb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4730ca41-aee5-4770-a6ea-a9c8c0efc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4730ca41-aee5-4770-a6ea-a9c8c0efc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562899156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7551f4e1-3fb4-47e0-9ada-f291f4dab51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299824c41e0a404f972f5dcb89cc63ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:50:48Z,use_quota=True,user_id='e11e756414e44830b98890c731443b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9887af-92f0-4a51-9b6d-b0f56d32626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9887af-92f0-4a51-9b6d-b0f56d32626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3b5e1a-9c52-49b6-86dc-597b727ee42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3b5e1a-9c52-49b6-86dc-597b727ee42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7551f4e1-3fb4-47e0-9ada-f291f4dab51f', 'volume_name': 'volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82c7a0-9f3d-4da6-ae8d-bf3bb0e23bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82c7a0-9f3d-4da6-ae8d-bf3bb0e23bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d48f7b-1c21-4022-9b90-5b4c742b047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Volume 7551f4e1-3fb4-47e0-9ada-f291f4dab51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f', 'volume_size': 1} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562899156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7551f4e1-3fb4-47e0-9ada-f291f4dab51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299824c41e0a404f972f5dcb89cc63ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:50:48Z,use_quota=True,user_id='e11e756414e44830b98890c731443b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Creating volume 7551f4e1-3fb4-47e0-9ada-f291f4dab51f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:50:48 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:48 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f 1073741824 Sep 03 13:50:48 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:48 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f 1073741824" returned: 0 in 0.388s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:48 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f Sep 03 13:50:48 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:48 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" returned: 0 in 0.236s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d48f7b-1c21-4022-9b90-5b4c742b047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15be968-9b2e-438c-aaab-319fc0b488c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Volume volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f (7551f4e1-3fb4-47e0-9ada-f291f4dab51f): created successfully Sep 03 13:50:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15be968-9b2e-438c-aaab-319fc0b488c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Flow 'volume_create_manager' (fb6e1f84-b732-47eb-a31a-3152a6aaeb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:50:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ff97dea3-3b07-4c73-a53d-bd55ee7619f8 tempest-ProjectReaderTests-1752043378 None] Created volume successfully. Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Acquiring lock "cinder-7551f4e1-3fb4-47e0-9ada-f291f4dab51f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "cinder-7551f4e1-3fb4-47e0-9ada-f291f4dab51f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Acquiring lock "cinder-quobyte-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "cinder-quobyte-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f43f9-41fd-424b-9077-ccc2c828c2f1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:49 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f Sep 03 13:50:49 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:49 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:49 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f Sep 03 13:50:49 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:50 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" returned: 0 in 0.239s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "cinder-quobyte-7551f4e1-3fb4-47e0-9ada-f291f4dab51f" released by "delete_volume" :: held 0.640s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Created reservations ['a93d176f-0638-4d42-9266-719f23387c6e', '57aa8a65-e26c-4ec5-b738-29f3b6df379e', 'cfb83f49-4a0d-4c67-b1dd-0359d4945749', '7bd30bd7-3038-46f3-843a-05c8d52635af'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:50 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:50:50 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:50 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.228s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:50:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Deleted volume successfully. Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8d940bb7-d56b-41b6-9ca6-f4eecec0e5ca tempest-ProjectReaderTests-1752043378 None] Lock "cinder-7551f4e1-3fb4-47e0-9ada-f291f4dab51f-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Flow 'volume_create_manager' (d8446a42-f86b-4e9e-b56b-d798b7acabf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531838be-fc42-4212-860f-69b55c2440a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531838be-fc42-4212-860f-69b55c2440a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454977899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac2cb60-fb74-4a20-ad87-c3f2a76afb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299824c41e0a404f972f5dcb89cc63ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:50:51Z,use_quota=True,user_id='e11e756414e44830b98890c731443b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf179a0d-6787-48af-8166-4e6ce1eedc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf179a0d-6787-48af-8166-4e6ce1eedc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf256f9-cf9b-4bb2-9f00-dbc1dc596adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf256f9-cf9b-4bb2-9f00-dbc1dc596adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac2cb60-fb74-4a20-ad87-c3f2a76afb95', 'volume_name': 'volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4f6ff3-05b0-41e1-9db3-9e396e90cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4f6ff3-05b0-41e1-9db3-9e396e90cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bbc0f8-9724-414f-b633-0fa571724c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Volume 7ac2cb60-fb74-4a20-ad87-c3f2a76afb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95', 'volume_size': 1} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454977899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac2cb60-fb74-4a20-ad87-c3f2a76afb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299824c41e0a404f972f5dcb89cc63ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:50:51Z,use_quota=True,user_id='e11e756414e44830b98890c731443b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Creating volume 7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:50:51 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:51 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 1073741824 Sep 03 13:50:51 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:51 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 1073741824" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:51 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 Sep 03 13:50:51 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:51 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" returned: 0 in 0.240s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bbc0f8-9724-414f-b633-0fa571724c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed84f489-7571-4c45-af70-cbce4a142f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:50:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Volume volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 (7ac2cb60-fb74-4a20-ad87-c3f2a76afb95): created successfully Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed84f489-7571-4c45-af70-cbce4a142f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Flow 'volume_create_manager' (d8446a42-f86b-4e9e-b56b-d798b7acabf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:50:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-93d569d3-437b-4a96-8bc2-8355b872bd57 tempest-ProjectReaderTests-1752043378 None] Created volume successfully. Sep 03 13:50:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "cinder-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "cinder-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "cinder-quobyte-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "cinder-quobyte-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6036788-9ae5-46d6-8465-3b462ff4acda]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:52 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 Sep 03 13:50:52 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:52 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" returned: 0 in 0.349s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:52 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95 Sep 03 13:50:52 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:52 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" returned: 0 in 0.244s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "cinder-quobyte-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95" released by "delete_volume" :: held 0.629s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Created reservations ['39caecc6-acdd-4abc-835d-65ab0288ea3f', '3e4b0610-d6bb-4420-97a5-c493d49c740b', 'bcb5a7f4-7a8e-4571-9204-6004b0b42d6a', 'b35b43df-2092-4661-9d3a-3f31d427a14e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:50:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:50:52 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:50:52 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:50:53 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 03 13:50:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:50:53 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:50:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Deleted volume successfully. Sep 03 13:50:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9a38639e-e35f-4918-9f5a-1b3b3207f573 tempest-ProjectReaderTests-1752043378 None] Lock "cinder-7ac2cb60-fb74-4a20-ad87-c3f2a76afb95-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:02 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=14,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:51:03 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=21,cinder:INSERT=7,cinder:SELECT=14,cinder:DELETE=2 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (87688259-4636-4fe2-9e47-2959d201e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d61a61a-29b0-4f2c-90d5-fe0e7e73cb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d61a61a-29b0-4f2c-90d5-fe0e7e73cb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699599687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9417e2-596a-4e31-961a-abce223cd2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5260ad8a-2973-47c5-afd5-13fec09dc484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5260ad8a-2973-47c5-afd5-13fec09dc484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ae37ea-8f4f-4af5-b499-288671edd97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ae37ea-8f4f-4af5-b499-288671edd97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9417e2-596a-4e31-961a-abce223cd2e8', 'volume_name': 'volume-af9417e2-596a-4e31-961a-abce223cd2e8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83ae8f9-6134-4be6-9f11-2142e65cbcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83ae8f9-6134-4be6-9f11-2142e65cbcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77207dd9-6ef7-4f99-a024-9bc0993e1bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Volume af9417e2-596a-4e31-961a-abce223cd2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9417e2-596a-4e31-961a-abce223cd2e8', 'volume_size': 1} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699599687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9417e2-596a-4e31-961a-abce223cd2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Creating volume af9417e2-596a-4e31-961a-abce223cd2e8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:05 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:05 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 1073741824 Sep 03 13:51:05 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Flow 'volume_create_manager' (6941b563-8279-489a-a9d1-afac80f244ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eb150a-f2e8-4d35-ab81-b8038ce15b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (cf1d1f63-a0d5-4f31-af1a-17bb89e726cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846c87e8-ec20-4a17-9e06-1d0b8f4cc876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eb150a-f2e8-4d35-ab81-b8038ce15b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126443671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce5a833-fe7f-4d48-922a-bb4ad2684277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9c3af1e026462fa743cea893190e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='195e08de5ee94b8dae59904510ff17a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab08acf1-f1b3-4331-88d1-d1936c02c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab08acf1-f1b3-4331-88d1-d1936c02c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912105f7-7376-4b44-86c6-1e8105da8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912105f7-7376-4b44-86c6-1e8105da8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce5a833-fe7f-4d48-922a-bb4ad2684277', 'volume_name': 'volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f8b99-9bc8-4fa8-92f6-a2c8af53d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f8b99-9bc8-4fa8-92f6-a2c8af53d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f6c42a-72ec-47d4-9330-dc776865aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Volume 2ce5a833-fe7f-4d48-922a-bb4ad2684277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277', 'volume_size': 1} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846c87e8-ec20-4a17-9e06-1d0b8f4cc876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374752716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a6bff9-7e42-47a9-9188-2e3c0d2333c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd86f63-82fc-4bc0-9ea6-d46e7a068931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd86f63-82fc-4bc0-9ea6-d46e7a068931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6277fc-90b2-44e5-8d8c-f23fcf3518c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6277fc-90b2-44e5-8d8c-f23fcf3518c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a6bff9-7e42-47a9-9188-2e3c0d2333c7', 'volume_name': 'volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232e8375-d2f2-4fdb-9f31-ae0be2247d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232e8375-d2f2-4fdb-9f31-ae0be2247d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f041d1b3-9bbd-438c-8ce7-33865d1b2a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:05 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Volume b0a6bff9-7e42-47a9-9188-2e3c0d2333c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7', 'volume_size': 1} Sep 03 13:51:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (6b7cdc96-4f15-4946-85f4-37b372088e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8c00bc-7609-4e74-8a0c-b595dea56860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 1073741824" returned: 0 in 0.714s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8c00bc-7609-4e74-8a0c-b595dea56860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184591836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d46d7-5a17-411a-9149-eb52f0915f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:06Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3725a6-229f-429d-95a2-70c4aae1bc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3725a6-229f-429d-95a2-70c4aae1bc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddf8933-d2bd-4321-91ef-338f29d81f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddf8933-d2bd-4321-91ef-338f29d81f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03d46d7-5a17-411a-9149-eb52f0915f8c', 'volume_name': 'volume-e03d46d7-5a17-411a-9149-eb52f0915f8c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf195e7-6f49-4e9d-8010-f7c391fd9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf195e7-6f49-4e9d-8010-f7c391fd9160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56fc517-5a2c-4e93-befc-85c7e4960db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume e03d46d7-5a17-411a-9149-eb52f0915f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03d46d7-5a17-411a-9149-eb52f0915f8c', 'volume_size': 1} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:06 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 Sep 03 13:51:06 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:06 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (00949004-0588-459a-9b61-b4f9a6835b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9daa43-085a-4ac9-9372-8aeb6f7a7e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8" returned: 0 in 0.331s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126443671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce5a833-fe7f-4d48-922a-bb4ad2684277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9c3af1e026462fa743cea893190e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='195e08de5ee94b8dae59904510ff17a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Creating volume 2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9daa43-085a-4ac9-9372-8aeb6f7a7e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3341807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd86de80-bc87-4ad0-9a28-4d30305855fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c50b40-51b3-4a6e-9620-43d953e102cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c50b40-51b3-4a6e-9620-43d953e102cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 1073741824 Sep 03 13:51:06 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf30309-3496-4eea-958c-3141968e33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf30309-3496-4eea-958c-3141968e33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd86de80-bc87-4ad0-9a28-4d30305855fc', 'volume_name': 'volume-bd86de80-bc87-4ad0-9a28-4d30305855fc', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c9837c-f3af-4f72-8b5e-8ee0b22c79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c9837c-f3af-4f72-8b5e-8ee0b22c79c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155baa3c-cf0e-44d3-a7b4-0aacee3ba700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Volume bd86de80-bc87-4ad0-9a28-4d30305855fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd86de80-bc87-4ad0-9a28-4d30305855fc', 'volume_size': 1} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77207dd9-6ef7-4f99-a024-9bc0993e1bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9417e2-596a-4e31-961a-abce223cd2e8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bde7284-7559-4015-91f1-fc9d20896fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Volume volume-af9417e2-596a-4e31-961a-abce223cd2e8 (af9417e2-596a-4e31-961a-abce223cd2e8): created successfully Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bde7284-7559-4015-91f1-fc9d20896fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (87688259-4636-4fe2-9e47-2959d201e067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (5ceea8af-9b9d-48e4-80f7-4965cafce4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14ff8b-8c74-4863-b509-2d1033188fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (dd5d6be0-d17c-4779-ab82-485ff3ae2123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0106ad-e9cb-4467-b425-03ac664ed3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-52311cbd-6ecc-4687-813a-c6f780cb69be tempest-CreateVolumesFromImageTest-980555689 None] Created volume successfully. Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14ff8b-8c74-4863-b509-2d1033188fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-747360902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0a0601-4864-46df-a8bf-ba43fa291a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c961ac5c-1f7d-4b06-96bf-ab38f34e12a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c961ac5c-1f7d-4b06-96bf-ab38f34e12a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b612710-418f-4795-8adb-cdf78c87e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b612710-418f-4795-8adb-cdf78c87e461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0a0601-4864-46df-a8bf-ba43fa291a2c', 'volume_name': 'volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5645b-65fe-4cca-8024-bcc48a3f76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5645b-65fe-4cca-8024-bcc48a3f76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb60f2f-ab71-4116-993d-085919b321f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Volume 3f0a0601-4864-46df-a8bf-ba43fa291a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c', 'volume_size': 1} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0106ad-e9cb-4467-b425-03ac664ed3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-912473273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197b73fc-3e1b-4380-84d7-14fb915f5184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ff889-a269-4978-851a-1a4c78cc77b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ff889-a269-4978-851a-1a4c78cc77b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53b456-4019-4d80-9b4f-ad7b33500c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:06 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53b456-4019-4d80-9b4f-ad7b33500c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197b73fc-3e1b-4380-84d7-14fb915f5184', 'volume_name': 'volume-197b73fc-3e1b-4380-84d7-14fb915f5184', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24342e99-9c46-45df-934c-c4c5eb52ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24342e99-9c46-45df-934c-c4c5eb52ef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1602b9-6ba6-47b6-a417-190f94dd84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:07 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Volume 197b73fc-3e1b-4380-84d7-14fb915f5184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197b73fc-3e1b-4380-84d7-14fb915f5184', 'volume_size': 1} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:07 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 1073741824" returned: 0 in 0.502s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:07 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:07 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:07 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374752716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a6bff9-7e42-47a9-9188-2e3c0d2333c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:05Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Creating volume b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:07 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f6c42a-72ec-47d4-9330-dc776865aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:07 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 1073741824 Sep 03 13:51:07 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e258ea9e-8d3d-4e37-a720-59524243183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:07 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Volume volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 (2ce5a833-fe7f-4d48-922a-bb4ad2684277): created successfully Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e258ea9e-8d3d-4e37-a720-59524243183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Flow 'volume_create_manager' (6941b563-8279-489a-a9d1-afac80f244ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a3a9fc25-ec01-43fd-87cc-b259043c21f7 tempest-VolumeDependencyTests-1344176831 None] Created volume successfully. Sep 03 13:51:07 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 1073741824" returned: 0 in 0.454s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:07 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 Sep 03 13:51:07 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:08 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184591836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d46d7-5a17-411a-9149-eb52f0915f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:06Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:08 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f041d1b3-9bbd-438c-8ce7-33865d1b2a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38bbee9-175a-42c0-9e76-6d7daf45664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:08 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c 1073741824 Sep 03 13:51:08 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:08 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Volume volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 (b0a6bff9-7e42-47a9-9188-2e3c0d2333c7): created successfully Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38bbee9-175a-42c0-9e76-6d7daf45664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (cf1d1f63-a0d5-4f31-af1a-17bb89e726cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f2dac77f-2611-4e91-9785-7b2e86e57ce3 tempest-CreateVolumesFromImageTest-980555689 None] Created volume successfully. Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:08 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c 1073741824" returned: 0 in 0.518s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:08 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c Sep 03 13:51:08 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:09 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.314s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3341807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd86de80-bc87-4ad0-9a28-4d30305855fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Creating volume bd86de80-bc87-4ad0-9a28-4d30305855fc {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56fc517-5a2c-4e93-befc-85c7e4960db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03d46d7-5a17-411a-9149-eb52f0915f8c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc 1073741824 Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8e1f47-73e8-4562-b640-ff01602d8469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-e03d46d7-5a17-411a-9149-eb52f0915f8c (e03d46d7-5a17-411a-9149-eb52f0915f8c): created successfully Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8e1f47-73e8-4562-b640-ff01602d8469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (6b7cdc96-4f15-4946-85f4-37b372088e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2bdcb17b-eba9-4921-bcb9-58805723ede4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Flow 'volume_create_manager' (4a7d07a0-9106-4ee7-8cdb-b358c3d244fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5648bc-c76f-4740-a175-2215963d5275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5648bc-c76f-4740-a175-2215963d5275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6a78d05bd447f1a3582cb59d7a2e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:09Z,use_quota=True,user_id='140891e9dff540c1822a59f8f01dcc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca49b453-a1c1-4bf4-95b0-3308edafba0a),volume_type_id=ca49b453-a1c1-4bf4-95b0-3308edafba0a)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d689f2-cbef-4bfc-9570-11b5fd0c2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d689f2-cbef-4bfc-9570-11b5fd0c2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb8b60-2b47-4fb9-b342-cbbbc37dbb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:51:09 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc 1073741824" returned: 0 in 0.449s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:09 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc Sep 03 13:51:09 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb8b60-2b47-4fb9-b342-cbbbc37dbb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231', 'volume_name': 'volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231', 'volume_size': 1, 'image_id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c90f05dd6a2fd71417cf26efe570f4b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb6a78d05bd447f1a3582cb59d7a2e7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd6f03755585c9b51580be4c3012cc495f4102590403c5f4bf0a7e4b866c397de5661e03fdc88d4a97f9710f898cd66335e3fbd19a53b7a94e61cca510147d02', 'id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb8ca5-eeb6-466a-b18d-ce5354e237b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb8ca5-eeb6-466a-b18d-ce5354e237b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aac0a08-3818-43b7-9877-9770635ab7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231', 'volume_size': 1, 'image_id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c90f05dd6a2fd71417cf26efe570f4b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb6a78d05bd447f1a3582cb59d7a2e7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd6f03755585c9b51580be4c3012cc495f4102590403c5f4bf0a7e4b866c397de5661e03fdc88d4a97f9710f898cd66335e3fbd19a53b7a94e61cca510147d02', 'id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Trying to clone fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 from image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:51:09 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-747360902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0a0601-4864-46df-a8bf-ba43fa291a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Creating volume 3f0a0601-4864-46df-a8bf-ba43fa291a2c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155baa3c-cf0e-44d3-a7b4-0aacee3ba700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd86de80-bc87-4ad0-9a28-4d30305855fc', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f891f4-1545-489d-904f-e3f06b53a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:09 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c 1073741824 Sep 03 13:51:09 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Volume volume-bd86de80-bc87-4ad0-9a28-4d30305855fc (bd86de80-bc87-4ad0-9a28-4d30305855fc): created successfully Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f891f4-1545-489d-904f-e3f06b53a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (00949004-0588-459a-9b61-b4f9a6835b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Image download 0.00 MB at 0.00 MB/s Sep 03 13:51:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1d1cb3f4-72ec-42e9-9874-40e26782372a tempest-CreateVolumesFromImageTest-980555689 None] Created volume successfully. Sep 03 13:51:09 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c735d-2f0a-493d-a626-6049ad84792e]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:10 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:10 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:10 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:10 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c 1073741824" returned: 0 in 0.518s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:10 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c Sep 03 13:51:10 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:10 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:10 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:10 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.697s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-912473273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197b73fc-3e1b-4380-84d7-14fb915f5184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85694f6e1cf3450fb641f8f9b3f008ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:07Z,use_quota=True,user_id='ee63c1a7a96d414189b5f3d3a37d5d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Creating volume 197b73fc-3e1b-4380-84d7-14fb915f5184 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:10 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:10 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Temporary image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 is fetched for user 140891e9dff540c1822a59f8f01dcc68. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:51:10 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 1073741824 Sep 03 13:51:10 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb60f2f-ab71-4116-993d-085919b321f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e1836-0731-47a2-a7ad-fdef13651fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Volume volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c (3f0a0601-4864-46df-a8bf-ba43fa291a2c): created successfully Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e1836-0731-47a2-a7ad-fdef13651fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (5ceea8af-9b9d-48e4-80f7-4965cafce4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fe980a07-3946-4525-8955-6a98dc1e3ad2 tempest-CreateVolumesFromImageTest-980555689 None] Created volume successfully. Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc2dad-1410-4bfc-9960-222e964144c5]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:10 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:10 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:11 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 1073741824" returned: 0 in 0.428s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:11 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:11 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 Sep 03 13:51:11 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:11 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:11 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:11 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.885s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1602b9-6ba6-47b6-a417-190f94dd84c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197b73fc-3e1b-4380-84d7-14fb915f5184', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9412341a-a8f5-4065-84e6-33917eaa5fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Creating offline snapshot 0959904c-f74b-4bb0-9031-3250d79549f5 of volume 2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:11 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:11 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Volume volume-197b73fc-3e1b-4380-84d7-14fb915f5184 (197b73fc-3e1b-4380-84d7-14fb915f5184): created successfully Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9412341a-a8f5-4065-84e6-33917eaa5fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Flow 'volume_create_manager' (dd5d6be0-d17c-4779-ab82-485ff3ae2123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73788e0-79f2-47dd-b014-fb8e8b49bc2f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8127e65a-159f-480d-8b6f-6cc2cd201b5f tempest-CreateVolumesFromImageTest-980555689 None] Created volume successfully. Sep 03 13:51:11 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:11 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:11 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.355s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:11 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 1G Sep 03 13:51:11 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-3f0a0601-4864-46df-a8bf-ba43fa291a2c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-3f0a0601-4864-46df-a8bf-ba43fa291a2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-quobyte-3f0a0601-4864-46df-a8bf-ba43fa291a2c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-3f0a0601-4864-46df-a8bf-ba43fa291a2c" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db7777-1df4-448e-ab83-d1f0310e54e0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:12 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 1G" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:12 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c Sep 03 13:51:12 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:12 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:12 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:12 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c" returned: 0 in 0.369s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:12 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:12 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c Sep 03 13:51:12 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.307s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:12 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 is being set with open permissions: ugo+rw Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:12 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:12 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:12 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-3f0a0601-4864-46df-a8bf-ba43fa291a2c" returned: 0 in 0.245s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-3f0a0601-4864-46df-a8bf-ba43fa291a2c" released by "delete_volume" :: held 0.653s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:12 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:12 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Created reservations ['34c37edb-1816-4dfb-ab31-3a803efbd137', 'f0f9d0a7-fb3f-4862-b4fb-49247a844b17', '35fd61b5-f92c-4494-9f59-5588e9084cd3', '699a8dad-ecc1-4237-a2c8-d8b10497a242'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:12 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info Sep 03 13:51:12 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:13 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:13 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info is being set with open permissions: ugo+rw Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info Sep 03 13:51:13 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-197b73fc-3e1b-4380-84d7-14fb915f5184-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Deleted volume successfully. Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-197b73fc-3e1b-4380-84d7-14fb915f5184-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ad52ac88-2176-4656-8a13-eb61ec6c94e8 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-3f0a0601-4864-46df-a8bf-ba43fa291a2c-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-quobyte-197b73fc-3e1b-4380-84d7-14fb915f5184" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-197b73fc-3e1b-4380-84d7-14fb915f5184" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a688c-2a68-4db4-9645-1a3015524058]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.info" returned: 0 in 0.238s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.993s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating offline snapshot 14723777-e7f7-4779-ad27-30dc6e495856 of volume e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2a59fb3f-06ef-43bb-9fff-c83af5e43853 tempest-VolumeDependencyTests-1344176831 None] Create snapshot completed successfully Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f7dfe-3e07-4de2-a05f-86d6e00d8d7d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 Sep 03 13:51:13 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c Sep 03 13:51:13 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184" returned: 0 in 0.394s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184 Sep 03 13:51:13 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:13 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:13 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 1G Sep 03 13:51:13 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:14 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-197b73fc-3e1b-4380-84d7-14fb915f5184" returned: 0 in 0.287s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-197b73fc-3e1b-4380-84d7-14fb915f5184" released by "delete_volume" :: held 0.723s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Created reservations ['af0c736d-ce53-408c-bbdb-d777048895b3', 'c049ae80-89e2-430c-af15-79f438f55101', 'ac5d9771-5a8b-4351-a331-786d993a7221', 'e873efcc-28e6-4de6-b5f9-4edf1ee438e3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:14 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:14 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:14 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 1G" returned: 0 in 0.451s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d46d7-5a17-411a-9149-eb52f0915f8c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Flow 'volume_create_manager' (7d2f9a37-70d3-4673-af64-5d9be46eca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d962db97-5a5c-4599-b4ba-395a42494f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:14 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d46d7-5a17-411a-9149-eb52f0915f8c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 Sep 03 13:51:14 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d962db97-5a5c-4599-b4ba-395a42494f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1326233967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e2d02e-8ee8-4aa4-b524-6bc04dac5a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9c3af1e026462fa743cea893190e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0959904c-f74b-4bb0-9031-3250d79549f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:14Z,use_quota=True,user_id='195e08de5ee94b8dae59904510ff17a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d1806a-7c1f-4074-981b-b2221d37cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d1806a-7c1f-4074-981b-b2221d37cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7efc08-be24-450e-a127-88de069384c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7efc08-be24-450e-a127-88de069384c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '77e2d02e-8ee8-4aa4-b524-6bc04dac5a35', 'volume_name': 'volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35', 'volume_size': 1, 'snapshot_id': '0959904c-f74b-4bb0-9031-3250d79549f5'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9898b5c8-4cfe-4ccc-84da-6624ebba9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9898b5c8-4cfe-4ccc-84da-6624ebba9320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a04944-ddd3-4932-944c-d7b6fe4fd981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:14 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Volume 77e2d02e-8ee8-4aa4-b524-6bc04dac5a35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35', 'volume_size': 1, 'snapshot_id': '0959904c-f74b-4bb0-9031-3250d79549f5'} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-bd86de80-bc87-4ad0-9a28-4d30305855fc-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-bd86de80-bc87-4ad0-9a28-4d30305855fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:14 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-quobyte-bd86de80-bc87-4ad0-9a28-4d30305855fc" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Deleted volume successfully. Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-bd86de80-bc87-4ad0-9a28-4d30305855fc" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-466afb7f-a491-45d9-b480-7710926abd30 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-197b73fc-3e1b-4380-84d7-14fb915f5184-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bbe154-2f03-4df6-ba0e-0e231605a38a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:14 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d46d7-5a17-411a-9149-eb52f0915f8c -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856" returned: 0 in 0.362s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:14 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 is being set with open permissions: ugo+rw Sep 03 13:51:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:14 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc Sep 03 13:51:14 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:14 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 Sep 03 13:51:14 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:14 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc" returned: 0 in 0.371s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc Sep 03 13:51:15 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info Sep 03 13:51:15 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bd86de80-bc87-4ad0-9a28-4d30305855fc" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-bd86de80-bc87-4ad0-9a28-4d30305855fc" released by "delete_volume" :: held 0.680s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:15 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info is being set with open permissions: ugo+rw Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Created reservations ['aafc99bc-f6bf-45cd-8397-8c91dcaeda33', '6bf9cdce-1f0b-4c9d-a7e2-b5680f2c8e55', 'cf6ede66-2d24-4c3f-8262-77dc36334304', '445ca209-89de-4cff-ba0a-c470b8eedf51'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:15 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info Sep 03 13:51:15 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:15 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:15 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.info" returned: 0 in 0.245s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.041s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6a78d05bd447f1a3582cb59d7a2e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:09Z,use_quota=True,user_id='140891e9dff540c1822a59f8f01dcc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca49b453-a1c1-4bf4-95b0-3308edafba0a),volume_type_id=ca49b453-a1c1-4bf4-95b0-3308edafba0a)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Creating volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:15 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1073741824 Sep 03 13:51:15 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b5b09ed0-2edc-47fc-9367-ea0f7e6cf994 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Create snapshot completed successfully Sep 03 13:51:15 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Deleted volume successfully. Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c5442d42-4f44-4ee9-b2af-fb466ed347b1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-bd86de80-bc87-4ad0-9a28-4d30305855fc-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-quobyte-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d769efb4-4b87-40ab-85b7-ac841bd27d10]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:15 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 Sep 03 13:51:15 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1073741824" returned: 0 in 0.468s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 Sep 03 13:51:16 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7 Sep 03 13:51:16 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.873s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Creating volume 77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 from snapshot 0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Attempting download of e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}])) to volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] snapshot: 0959904c-f74b-4bb0-9031-3250d79549f5, volume: 77e2d02e-8ee8-4aa4-b524-6bc04dac5a35, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:51:16 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9fde1-712c-4e51-9650-1855017549e1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a94c05-7a49-4ddd-a896-a3af57a36219]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7" released by "delete_volume" :: held 0.705s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Created reservations ['505722bc-f7e1-46c8-8269-8bb1b5092d17', '18d30819-61e3-4d01-ba3b-1dd083dbcd2e', '4ddbca9d-19bd-4b82-a7ca-96b60bad0507', '0271ca38-ad67-4de9-90ce-17b77e97930f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:16 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:16 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze Sep 03 13:51:16 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:16 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-af9417e2-596a-4e31-961a-abce223cd2e8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:16 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.307s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:16 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze" returned: 0 in 0.478s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Deleted volume successfully. Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637ade7-6ec6-4339-848a-c21cfe59a211]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-af9417e2-596a-4e31-961a-abce223cd2e8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-631dd915-e6ce-4d1b-b699-c6aac675d822 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-b0a6bff9-7e42-47a9-9188-2e3c0d2333c7-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "cinder-quobyte-af9417e2-596a-4e31-961a-abce223cd2e8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-af9417e2-596a-4e31-961a-abce223cd2e8" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:17 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze Sep 03 13:51:17 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5e175-17e8-4402-8886-f29f767685ca]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:17 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:17 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:17 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 Sep 03 13:51:17 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:17 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:17 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.510s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze" returned: 1 in 0.558s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_kwo_ukze' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:17 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 Sep 03 13:51:17 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (6fd1d9ed-a0b0-44e1-a9d2-816ad92256ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e1f6a1-36fb-49b7-9049-1d1f324353ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c83f374-a0d7-471d-aa09-f4c6f6e6c0bb]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e1f6a1-36fb-49b7-9049-1d1f324353ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190056278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f82bf1-c82f-4367-9dca-768b275ae131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:17Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16546de1-2a2d-452c-ab6c-1e06802f4eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16546de1-2a2d-452c-ab6c-1e06802f4eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23386200-78b7-41bd-b667-5dda8f9c7847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23386200-78b7-41bd-b667-5dda8f9c7847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f82bf1-c82f-4367-9dca-768b275ae131', 'volume_name': 'volume-e6f82bf1-c82f-4367-9dca-768b275ae131', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6e74d3-1710-4c66-87b4-ae31c674258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6e74d3-1710-4c66-87b4-ae31c674258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:17 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5c2178-aaeb-4647-9bef-f62b9359fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:17 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume e6f82bf1-c82f-4367-9dca-768b275ae131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f82bf1-c82f-4367-9dca-768b275ae131', 'volume_size': 1} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8" returned: 0 in 0.569s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:17 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8 Sep 03 13:51:17 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:17 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:17 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (697a0772-1ad4-4603-b79c-ed4e710d6623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:18 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:18 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9115bf24-c802-4078-ba13-c09964f49a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-af9417e2-596a-4e31-961a-abce223cd2e8" returned: 0 in 0.399s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9115bf24-c802-4078-ba13-c09964f49a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647823463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4509428a-f880-4396-ae53-fd2a58ae5a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:18Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31868a7-d78e-4716-bfbd-06556d4cb2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31868a7-d78e-4716-bfbd-06556d4cb2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec57a06-a6db-47c8-b967-e70211819c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec57a06-a6db-47c8-b967-e70211819c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4509428a-f880-4396-ae53-fd2a58ae5a97', 'volume_name': 'volume-4509428a-f880-4396-ae53-fd2a58ae5a97', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7321c9-026c-4bad-bb4f-402ff5c9243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7321c9-026c-4bad-bb4f-402ff5c9243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57519917-7a9e-4039-ac59-a891e687a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:18 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume 4509428a-f880-4396-ae53-fd2a58ae5a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4509428a-f880-4396-ae53-fd2a58ae5a97', 'volume_size': 1} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 0 in 0.597s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-quobyte-af9417e2-596a-4e31-961a-abce223cd2e8" released by "delete_volume" :: held 1.107s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:18 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD Sep 03 13:51:18 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Created reservations ['958718b0-6d54-4bb9-87e7-31bb984a9e1c', '306ee4f1-c48b-4602-b22f-ce8efe4361bc', 'f4b2e0ae-c377-4875-963b-aecf5d7a4ebf', '011eff62-3550-4e05-b8c0-4588652e3fd3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:18 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:18 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:18 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD" returned: 1 in 0.675s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 was raw, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:51:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:19 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 Sep 03 13:51:19 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (64d5f302-d151-498d-b7cd-91f1bf3d42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a4756-6f06-4daf-9a7f-0b87ff05d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a4756-6f06-4daf-9a7f-0b87ff05d635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219329393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c469cd13-0ff6-4568-bfec-1db9f5eaa01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:19Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92ec450-9bfb-4932-8018-e9807cca310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92ec450-9bfb-4932-8018-e9807cca310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ff911-bc07-4ddb-913e-fc366d416593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ff911-bc07-4ddb-913e-fc366d416593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c469cd13-0ff6-4568-bfec-1db9f5eaa01a', 'volume_name': 'volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48746c-338a-437b-9a71-02d52125af73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48746c-338a-437b-9a71-02d52125af73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b5326c-b2a2-45c8-9015-edad05c949b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:19 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume c469cd13-0ff6-4568-bfec-1db9f5eaa01a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a', 'volume_size': 1} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:19 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 1.006s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Deleted volume successfully. Sep 03 13:51:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-080b3649-cc7e-4a8f-bad4-ff63532f3ee1 tempest-CreateVolumesFromImageTest-980555689 None] Lock "cinder-af9417e2-596a-4e31-961a-abce223cd2e8-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:20 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" returned: 0 in 1.508s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8_xjd98cd_devstack@QuobyteHD, size 0.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:51:20 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:20 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1G Sep 03 13:51:20 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (069a6658-0618-4140-9ba9-44aadc5e1637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5800f91-e28c-43c3-8a41-b2d6b77454bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5800f91-e28c-43c3-8a41-b2d6b77454bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919527046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d6f1b-38eb-435d-b98e-da8acfad7b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:20Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98b4559-36ff-4853-9fb1-b83b337ccb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98b4559-36ff-4853-9fb1-b83b337ccb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f086675-22c7-45b7-ae5b-b5d8b4f2c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f086675-22c7-45b7-ae5b-b5d8b4f2c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6d6f1b-38eb-435d-b98e-da8acfad7b0c', 'volume_name': 'volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91498f86-2fdd-4f0d-b661-e45c23e92c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91498f86-2fdd-4f0d-b661-e45c23e92c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceed3747-846c-43cf-8b78-edabc6b04d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:20 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume fb6d6f1b-38eb-435d-b98e-da8acfad7b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c', 'volume_size': 1} Sep 03 13:51:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (7bee27a5-e975-4877-be69-3c7440b8a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c1a2f-f6ee-4707-a1a1-f55be9c1b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c1a2f-f6ee-4707-a1a1-f55be9c1b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:21Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a5d84-c05a-4b80-9a43-70a34a2cc4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a5d84-c05a-4b80-9a43-70a34a2cc4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d3655-f219-4b73-a40c-78b3f5636418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d3655-f219-4b73-a40c-78b3f5636418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b', 'volume_name': 'volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df6637e-c580-4303-a1af-aaa755b7f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df6637e-c580-4303-a1af-aaa755b7f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b94cdc5-13a5-411d-9551-dc8c1d53b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b', 'volume_size': 1} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 1G" returned: 0 in 1.134s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Downloaded image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}])) to volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Temporary image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 for user 140891e9dff540c1822a59f8f01dcc68 is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Marking volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Copying metadata from image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 to fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Creating volume glance metadata for volume fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 backed by image e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c90f05dd6a2fd71417cf26efe570f4b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aac0a08-3818-43b7-9877-9770635ab7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231', 'volume_size': 1, 'image_id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c90f05dd6a2fd71417cf26efe570f4b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb6a78d05bd447f1a3582cb59d7a2e7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd6f03755585c9b51580be4c3012cc495f4102590403c5f4bf0a7e4b866c397de5661e03fdc88d4a97f9710f898cd66335e3fbd19a53b7a94e61cca510147d02', 'id': 'e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3d428e4-f558-44f3-bbbd-6cbc3f9ad3e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca1e24-ddca-4b9b-88bb-eb586c1c0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Volume volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 (fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231): created successfully Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca1e24-ddca-4b9b-88bb-eb586c1c0813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Flow 'volume_create_manager' (4a7d07a0-9106-4ee7-8cdb-b358c3d244fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:21 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f694163e-a7ab-43d9-8295-47d24b7c3859 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Created volume successfully. Sep 03 13:51:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Acquiring lock "cinder-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "cinder-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Acquiring lock "cinder-quobyte-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "cinder-quobyte-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[809093fb-b713-4e5d-ba05-59c7c79844c9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:23 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 Sep 03 13:51:23 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:23 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" returned: 0 in 0.905s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:23 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231 Sep 03 13:51:23 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:24 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" returned: 0 in 6.506s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:51:24 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Converted 1024.00 MB image at 157.28 MB/s Sep 03 13:51:24 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 is being set with open permissions: ugo+rw Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:24 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 Sep 03 13:51:24 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:24 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" returned: 0 in 0.285s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "cinder-quobyte-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231" released by "delete_volume" :: held 1.269s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Created reservations ['e47df10b-8e90-42c0-81f5-64b2334b11c8', '21b59098-ad28-4f33-b859-8a6aa36dfe31', 'e83406c4-8020-44c6-a6c0-fa197b068d80', '2ebace35-d77d-4d33-b55f-004f93e12c64'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:24 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" released by "_copy_volume_from_snapshot" :: held 7.900s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" released by "_create_volume_from_snapshot" :: held 8.011s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.035s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.680s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:24 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:24 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190056278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f82bf1-c82f-4367-9dca-768b275ae131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:17Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume e6f82bf1-c82f-4367-9dca-768b275ae131 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:24 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:24 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 1073741824 Sep 03 13:51:24 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a04944-ddd3-4932-944c-d7b6fe4fd981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35', 'volume_size': 1, 'snapshot_id': '0959904c-f74b-4bb0-9031-3250d79549f5'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd10bf7e-4212-44ae-b559-5649e8b956fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:24 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Volume volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 (77e2d02e-8ee8-4aa4-b524-6bc04dac5a35): created successfully Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd10bf7e-4212-44ae-b559-5649e8b956fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Flow 'volume_create_manager' (7d2f9a37-70d3-4673-af64-5d9be46eca73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9432d5c1-36e8-4aec-8fba-1c5a98f017d6 tempest-VolumeDependencyTests-1344176831 None] Created volume successfully. Sep 03 13:51:24 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.281s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Deleted volume successfully. Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-99c59eea-97f5-44ec-948d-b04a5ab85f61 tempest-VolumeAndVolumeTypeFromImageTest-2094967483 None] Lock "cinder-fa9b6cb4-e6dd-4c2e-8bae-9d8b235ec231-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:24 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 1073741824" returned: 0 in 0.469s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:24 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 Sep 03 13:51:24 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:25 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647823463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4509428a-f880-4396-ae53-fd2a58ae5a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:18Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume 4509428a-f880-4396-ae53-fd2a58ae5a97 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:25 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5c2178-aaeb-4647-9bef-f62b9359fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f82bf1-c82f-4367-9dca-768b275ae131', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c46440-a390-458f-b1ec-f69d56a158f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:25 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 1073741824 Sep 03 13:51:25 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:25 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-e6f82bf1-c82f-4367-9dca-768b275ae131 (e6f82bf1-c82f-4367-9dca-768b275ae131): created successfully Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c46440-a390-458f-b1ec-f69d56a158f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (6fd1d9ed-a0b0-44e1-a9d2-816ad92256ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5a0c2051-d569-4d86-89e6-d55e334d9b4a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-0959904c-f74b-4bb0-9031-3250d79549f5-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-0959904c-f74b-4bb0-9031-3250d79549f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Deleting offline snapshot 0959904c-f74b-4bb0-9031-3250d79549f5 of volume 2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] snapshot_file for this snap is: volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cafe3b-9787-4f1a-b754-91ea61336531]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:25 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 1073741824" returned: 0 in 0.618s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:25 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:25 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:25 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 Sep 03 13:51:25 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:26 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219329393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c469cd13-0ff6-4568-bfec-1db9f5eaa01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:19Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume c469cd13-0ff6-4568-bfec-1db9f5eaa01a {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:26 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:26 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.464s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:26 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a 1073741824 Sep 03 13:51:26 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57519917-7a9e-4039-ac59-a891e687a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4509428a-f880-4396-ae53-fd2a58ae5a97', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f45841-c951-4e58-bdf7-1f58b8602e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d079b572-cdfa-40e0-a648-fc14f0fd2796]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-4509428a-f880-4396-ae53-fd2a58ae5a97 (4509428a-f880-4396-ae53-fd2a58ae5a97): created successfully Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f45841-c951-4e58-bdf7-1f58b8602e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (697a0772-1ad4-4603-b79c-ed4e710d6623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3c111c8a-0400-49ee-9c22-0287536fd3cd tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:26 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:26 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:26 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a 1073741824" returned: 0 in 0.546s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:26 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a Sep 03 13:51:26 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:26 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.724s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:27 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:27 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:27 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.178s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919527046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d6f1b-38eb-435d-b98e-da8acfad7b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:20Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume fb6d6f1b-38eb-435d-b98e-da8acfad7b0c {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:27 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b5326c-b2a2-45c8-9015-edad05c949b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4641f01e-9ef6-4d8c-9ae2-fc96735cee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:27 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c 1073741824 Sep 03 13:51:27 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:27 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a (c469cd13-0ff6-4568-bfec-1db9f5eaa01a): created successfully Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4641f01e-9ef6-4d8c-9ae2-fc96735cee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (64d5f302-d151-498d-b7cd-91f1bf3d42d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-218df7c6-306d-419e-ba5c-8dd85ffc0d55 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:27 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.454s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:27 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5 Sep 03 13:51:27 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:27 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277.0959904c-f74b-4bb0-9031-3250d79549f5" returned: 0 in 0.391s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:27 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c 1073741824" returned: 0 in 0.662s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-0959904c-f74b-4bb0-9031-3250d79549f5" released by "_delete_snapshot" :: held 2.177s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" released by "delete_snapshot" :: held 2.236s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:27 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c Sep 03 13:51:27 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:27 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Created reservations ['c40e365a-ec00-4aca-9ba4-65377f8d4eba', '873105fc-457b-4c06-b2ed-32e608a47ef3', 'b04f7fd7-5e48-43c4-bd6d-055d29eb1176', '746cb21e-5da0-4846-8b23-5f7d154e4bb6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Delete snapshot completed successfully. Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cffe1a72-108c-44ff-9772-bd1f5be95f0f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-0959904c-f74b-4bb0-9031-3250d79549f5-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:28 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Flow 'volume_create_manager' (c53bbc7f-4107-4834-95f3-5ee2dee5cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca7072-d098-4290-aa67-fb3ee5bc3b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" returned: 0 in 0.392s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.741s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8665735ca4ee3b77b32f20c9f4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:21Z,use_quota=True,user_id='de153ec861f54dae8d6328beb2dacd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Creating volume cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceed3747-846c-43cf-8b78-edabc6b04d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ca3d7e-2519-4373-9aa5-12d3320aa0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b 1073741824 Sep 03 13:51:28 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca7072-d098-4290-aa67-fb3ee5bc3b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8198b8b9-cdf7-4553-b32e-a0a046a30e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a121b7459e247c784f5615498494519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:28Z,use_quota=True,user_id='1af35edbcd1c4935a9d8b6f74ae08c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d9f967-4595-4b36-9fee-bf5c212b0702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d9f967-4595-4b36-9fee-bf5c212b0702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7260ee22-83f3-4e66-8758-c4a1fee488d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.image.glance [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Creating Keystone auth plugin from conf {{(pid=86933) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c (fb6d6f1b-38eb-435d-b98e-da8acfad7b0c): created successfully Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ca3d7e-2519-4373-9aa5-12d3320aa0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (069a6658-0618-4140-9ba9-44aadc5e1637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a676475-8dc6-4484-a210-ee4deff7cc0a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7260ee22-83f3-4e66-8758-c4a1fee488d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8198b8b9-cdf7-4553-b32e-a0a046a30e7e', 'volume_name': 'volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e', 'volume_size': 1, 'image_id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3d2c59bee315e11b4d3bfd693ce21b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a121b7459e247c784f5615498494519', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '698e44f45bc15f87c90455c79677d8ee1310d8b1997ed6071648f79985c9175469ae34d916acff52092ba125ba50c0976b943344c8fec76f7d923f687147f729', 'id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758cb45a-7603-4d45-bc39-c98579b9e9e4/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa34f627-ad7f-45a8-992d-63665500acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa34f627-ad7f-45a8-992d-63665500acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6e46b6-bc78-421d-93bb-567653b41274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e', 'volume_size': 1, 'image_id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3d2c59bee315e11b4d3bfd693ce21b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a121b7459e247c784f5615498494519', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '698e44f45bc15f87c90455c79677d8ee1310d8b1997ed6071648f79985c9175469ae34d916acff52092ba125ba50c0976b943344c8fec76f7d923f687147f729', 'id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758cb45a-7603-4d45-bc39-c98579b9e9e4/file', 'properties': {}}, 'image_service': } Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Trying to clone 8198b8b9-cdf7-4553-b32e-a0a046a30e7e from image 758cb45a-7603-4d45-bc39-c98579b9e9e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}]). {{(pid=86933) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 13:51:28 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b 1073741824" returned: 0 in 0.539s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-2ce5a833-fe7f-4d48-922a-bb4ad2684277-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-2ce5a833-fe7f-4d48-922a-bb4ad2684277-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:28 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b Sep 03 13:51:28 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 13:51:28 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Image download 0.00 MB at 0.00 MB/s Sep 03 13:51:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60153e5b-d683-468e-82dd-179466a7718a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d335cc6e-675a-4e58-a876-35424099ac3d]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:29 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:29 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:29 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b94cdc5-13a5-411d-9551-dc8c1d53b8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61559eb7-1760-4361-846a-59dccacac4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:29 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:29 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Volume volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b (cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b): created successfully Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61559eb7-1760-4361-846a-59dccacac4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Flow 'volume_create_manager' (7bee27a5-e975-4877-be69-3c7440b8a076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a35ed7fd-5058-45cf-8d1c-8a7c652acac4 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created volume successfully. Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:29 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:29 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.555s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" acquired by "delete_volume" :: waited 0.057s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64d5718-78ec-4674-8101-665f51c8e13d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:29 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277 Sep 03 13:51:29 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:29 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:29 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:29 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b Sep 03 13:51:29 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:29 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:29 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Temporary image 758cb45a-7603-4d45-bc39-c98579b9e9e4 is fetched for user 1af35edbcd1c4935a9d8b6f74ae08c5e. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-2ce5a833-fe7f-4d48-922a-bb4ad2684277" returned: 0 in 0.345s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-2ce5a833-fe7f-4d48-922a-bb4ad2684277" released by "delete_volume" :: held 0.981s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638846f-e110-4eff-8ee2-a590ee7e04f2]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" returned: 0 in 0.424s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Created reservations ['6351403c-9c85-46af-9ab9-4d01ccf4f6c9', 'd214848f-a5d2-4cd6-a076-e264a177e8c4', '7bb05884-dafe-48d9-9d46-a58eba1d0d17', 'db4b1687-d50d-440e-8780-6004eae3dacc'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:30 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b Sep 03 13:51:30 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:30 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:30 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b" released by "delete_volume" :: held 0.769s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:30 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['ff59d15d-2f65-4086-abc4-13ac51e5b95c', 'a419edfe-f318-4728-81af-df496c0b7409', 'f4b08e22-7f42-4860-8ef6-f8553caa1ee6', 'fc5e5a04-8031-478d-912d-1851c42414a8'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:30 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.308s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Deleted volume successfully. Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7d51bf5a-5e7f-4e4c-9ac1-434fe7520f9f tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-2ce5a833-fe7f-4d48-922a-bb4ad2684277-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:30 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:30 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:30 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d87da-06f5-42f0-b581-ae162544fa2d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8198b8b9-cdf7-4553-b32e-a0a046a30e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a121b7459e247c784f5615498494519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:28Z,use_quota=True,user_id='1af35edbcd1c4935a9d8b6f74ae08c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Creating volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:30 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.312s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:30 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1073741824 Sep 03 13:51:30 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1af9ff09-3129-4367-ba05-cd8f6875fffc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-cfe4b003-b55c-44fc-be7d-a9a9d3c8ea2b-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:30 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c Sep 03 13:51:30 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff70d30-0640-4a92-8f95-6cb0111fd7a5]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:31 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" returned: 0 in 0.465s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:31 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c Sep 03 13:51:31 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1073741824" returned: 0 in 0.568s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:31 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 Sep 03 13:51:31 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:31 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e Sep 03 13:51:31 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c" released by "delete_volume" :: held 0.814s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['cee9f21e-9814-4bc5-9832-fcb5c2610cd2', '84b21b51-3961-46eb-9195-56333943f405', 'af3b118d-35d6-4442-9d4c-9cd6c45f7a0d', '5e547969-4627-4253-b1aa-a7742c4be5d0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:31 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" returned: 0 in 0.506s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:31 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:31 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:31 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35 Sep 03 13:51:31 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Attempting download of 758cb45a-7603-4d45-bc39-c98579b9e9e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}])) to volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-c469cd13-0ff6-4568-bfec-1db9f5eaa01a-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a90f8f-4275-45fc-8da2-9a6216880552]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-c469cd13-0ff6-4568-bfec-1db9f5eaa01a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a42688-520d-404d-83fb-a313d47e5ca3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:32 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.356s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:32 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47 Sep 03 13:51:32 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-eec6bc11-c817-42e8-a2a6-dab7eea05e1a tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-fb6d6f1b-38eb-435d-b98e-da8acfad7b0c-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:32 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-quobyte-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35" released by "delete_volume" :: held 0.983s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Created reservations ['a1cc75a6-5a2a-4e05-8d9d-b8dd6d8a480c', 'f6ea8bdc-8e05-4de4-8de1-462a94fa2786', 'ef05cf1d-b060-40fc-a14c-eb8c79a3e684', '3ca30dbc-8881-443a-b238-6ee6707a805e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:32 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a Sep 03 13:51:32 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:32 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:32 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:32 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47" returned: 0 in 0.539s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:32 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.329s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:32 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Deleted volume successfully. Sep 03 13:51:32 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47 Sep 03 13:51:32 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" returned: 0 in 0.585s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-ac1a6e97-d183-4613-9130-718a15ba4067 tempest-VolumeDependencyTests-1344176831 None] Lock "cinder-77e2d02e-8ee8-4aa4-b524-6bc04dac5a35-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:32 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a Sep 03 13:51:32 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:32 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47" returned: 1 in 0.484s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758cb45a-7603-4d45-bc39-c98579b9e9e4__ui0tj47' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1466ee-b57f-4306-8ff8-55073cd9e86e]: (4, 'raw') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:33 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-c469cd13-0ff6-4568-bfec-1db9f5eaa01a" released by "delete_volume" :: held 0.991s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:33 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['24fa9013-8a28-4328-b9e8-74d3455a2fdb', '66cb105e-ec70-400b-8bd5-115f152eda1a', 'ed390151-4f8e-4474-89ac-c1d62ad2ebe1', 'c801e949-2539-4491-bb1c-e1ba65867567'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:33 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:33 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:33 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:33 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:33 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fff62ff1-0e03-4a27-b590-da233b00d209 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-c469cd13-0ff6-4568-bfec-1db9f5eaa01a-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:33 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD Sep 03 13:51:33 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:51:33 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] 758cb45a-7603-4d45-bc39-c98579b9e9e4 was raw, converting to qcow2 {{(pid=86933) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 13:51:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:33 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e Sep 03 13:51:33 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-4509428a-f880-4396-ae53-fd2a58ae5a97-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-4509428a-f880-4396-ae53-fd2a58ae5a97-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-4509428a-f880-4396-ae53-fd2a58ae5a97" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-4509428a-f880-4396-ae53-fd2a58ae5a97" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14590bbf-82ab-4675-92f2-d8f62350b67c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:34 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" returned: 0 in 0.621s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_758cb45a-7603-4d45-bc39-c98579b9e9e4_2hxd5_qedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:51:34 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:34 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 Sep 03 13:51:34 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:34 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1G Sep 03 13:51:34 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:34 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97" returned: 0 in 0.489s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:34 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97 Sep 03 13:51:34 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:35 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e 1G" returned: 0 in 0.471s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Downloaded image 758cb45a-7603-4d45-bc39-c98579b9e9e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}])) to volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e successfully. {{(pid=86933) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Temporary image 758cb45a-7603-4d45-bc39-c98579b9e9e4 for user 1af35edbcd1c4935a9d8b6f74ae08c5e is deleted. {{(pid=86933) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.volume_utils [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Marking volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e as bootable. {{(pid=86933) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Copying metadata from image 758cb45a-7603-4d45-bc39-c98579b9e9e4 to 8198b8b9-cdf7-4553-b32e-a0a046a30e7e. {{(pid=86933) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Creating volume glance metadata for volume 8198b8b9-cdf7-4553-b32e-a0a046a30e7e backed by image 758cb45a-7603-4d45-bc39-c98579b9e9e4 with: {'image_id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3d2c59bee315e11b4d3bfd693ce21b7e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86933) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6e46b6-bc78-421d-93bb-567653b41274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e', 'volume_size': 1, 'image_id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758cb45a-7603-4d45-bc39-c98579b9e9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3d2c59bee315e11b4d3bfd693ce21b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a121b7459e247c784f5615498494519', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '698e44f45bc15f87c90455c79677d8ee1310d8b1997ed6071648f79985c9175469ae34d916acff52092ba125ba50c0976b943344c8fec76f7d923f687147f729', 'id': '758cb45a-7603-4d45-bc39-c98579b9e9e4', 'created_at': datetime.datetime(2026, 9, 3, 11, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 11, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758cb45a-7603-4d45-bc39-c98579b9e9e4/file', 'properties': {}}, 'image_service': }' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665e8208-e9b4-4bb9-a33b-95c3cb450bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:35 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Volume volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e (8198b8b9-cdf7-4553-b32e-a0a046a30e7e): created successfully Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665e8208-e9b4-4bb9-a33b-95c3cb450bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Flow 'volume_create_manager' (c53bbc7f-4107-4834-95f3-5ee2dee5cd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-72474962-f90b-4569-b3e6-4c3aa67b30d9 tempest-VolumeImageDependencyTests-1248874587 None] Created volume successfully. Sep 03 13:51:35 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-4509428a-f880-4396-ae53-fd2a58ae5a97" returned: 0 in 0.295s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-4509428a-f880-4396-ae53-fd2a58ae5a97" released by "delete_volume" :: held 0.839s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['0bc859ea-9dc8-484c-96d5-a3da638a55a0', 'c20ac57d-ad67-4a85-9d11-ebcd1e351cf0', '657cd3f6-ef70-4d20-9eae-7ea0209bd6d9', '1092384a-73ab-4d6e-b710-b70559b37f0a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:35 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:35 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-e6f82bf1-c82f-4367-9dca-768b275ae131-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-e6f82bf1-c82f-4367-9dca-768b275ae131-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-e6f82bf1-c82f-4367-9dca-768b275ae131" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e6f82bf1-c82f-4367-9dca-768b275ae131" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:35 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.359s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c3ac90-9025-46b2-a42c-e31303ef158b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e7edefb0-968e-4086-acc5-d4cd3660923c tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-4509428a-f880-4396-ae53-fd2a58ae5a97-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:35 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 Sep 03 13:51:35 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Acquiring lock "cinder-8198b8b9-cdf7-4553-b32e-a0a046a30e7e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "cinder-8198b8b9-cdf7-4553-b32e-a0a046a30e7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:35 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Acquiring lock "cinder-quobyte-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "cinder-quobyte-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a6ff0-0a50-4caa-b91f-fb8101c9a5f9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:36 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e Sep 03 13:51:36 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:36 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131" returned: 0 in 0.556s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:36 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131 Sep 03 13:51:36 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Flow 'volume_create_manager' (3c42fa77-c1bb-410e-b6cb-6436745d0ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ada2784-9533-45ae-9cb2-557f70c90876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ada2784-9533-45ae-9cb2-557f70c90876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef966d2e-947f-43fb-b59e-65fbccdb3656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d162701e1f4d869e88ebb6032200a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:36Z,use_quota=True,user_id='6c2edc2cc60047bd9f274ba850a18346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe38153-e20e-43ee-b181-c5bda6104b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe38153-e20e-43ee-b181-c5bda6104b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017e3d3a-c4e7-4e8d-84a5-1c5202e5f02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017e3d3a-c4e7-4e8d-84a5-1c5202e5f02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef966d2e-947f-43fb-b59e-65fbccdb3656', 'volume_name': 'volume-ef966d2e-947f-43fb-b59e-65fbccdb3656', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:36 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99498f11-731c-4c4e-8b35-0d00ff1ca23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99498f11-731c-4c4e-8b35-0d00ff1ca23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d382a4-b7c7-4944-bd55-79bc40b3e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:36 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Volume ef966d2e-947f-43fb-b59e-65fbccdb3656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef966d2e-947f-43fb-b59e-65fbccdb3656', 'volume_size': 1} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef966d2e-947f-43fb-b59e-65fbccdb3656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d162701e1f4d869e88ebb6032200a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:36Z,use_quota=True,user_id='6c2edc2cc60047bd9f274ba850a18346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Creating volume ef966d2e-947f-43fb-b59e-65fbccdb3656 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:36 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" returned: 0 in 0.483s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:36 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 1073741824 Sep 03 13:51:36 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:36 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e Sep 03 13:51:36 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:36 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e6f82bf1-c82f-4367-9dca-768b275ae131" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e6f82bf1-c82f-4367-9dca-768b275ae131" released by "delete_volume" :: held 0.963s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['02d22067-4993-4298-bde9-35f5a55ab5f9', 'a8e99aa5-e247-4838-8734-a6ac1847c649', '16931af1-ac4c-4a2a-bd68-d8b4113aa95a', 'ffb439f9-c67b-4202-a38a-d673742a3b44'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:36 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" returned: 0 in 0.337s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:36 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:36 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "cinder-quobyte-8198b8b9-cdf7-4553-b32e-a0a046a30e7e" released by "delete_volume" :: held 0.877s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:36 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Created reservations ['1bd2320f-0371-4404-af7b-a9fa6c3902f2', '33362468-93ff-4042-bc73-908930f22e33', '64bdb70b-d208-4acc-9f13-c3b3d8cdd271', '120be8b5-4f49-40cb-bf73-e3e045140730'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:37 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:37 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:37 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 1073741824" returned: 0 in 0.593s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:37 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 Sep 03 13:51:37 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:37 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.413s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8dcacb12-439f-4f22-b4db-931400e7dbfc tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-e6f82bf1-c82f-4367-9dca-768b275ae131-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:37 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.334s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Deleted volume successfully. Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-05fc16eb-7e33-4290-b4cd-2fd4fc304bad tempest-VolumeImageDependencyTests-1248874587 None] Lock "cinder-8198b8b9-cdf7-4553-b32e-a0a046a30e7e-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:37 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656" returned: 0 in 0.359s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d382a4-b7c7-4944-bd55-79bc40b3e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef966d2e-947f-43fb-b59e-65fbccdb3656', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97c2aa0-1967-4ee5-a27b-c91ba91ac883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:37 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Volume volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 (ef966d2e-947f-43fb-b59e-65fbccdb3656): created successfully Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97c2aa0-1967-4ee5-a27b-c91ba91ac883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Flow 'volume_create_manager' (3c42fa77-c1bb-410e-b6cb-6436745d0ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:37 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-180900b9-6e7d-4d69-992a-1447eaff2e84 tempest-CinderUnicodeTest-909276488 None] Created volume successfully. Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-14723777-e7f7-4779-ad27-30dc6e495856-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-14723777-e7f7-4779-ad27-30dc6e495856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-14723777-e7f7-4779-ad27-30dc6e495856" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-14723777-e7f7-4779-ad27-30dc6e495856" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleting offline snapshot 14723777-e7f7-4779-ad27-30dc6e495856 of volume e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] snapshot_file for this snap is: volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f936d2d-d97c-4c5c-a210-26f0d734ddc1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:38 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 Sep 03 13:51:38 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:38 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856" returned: 0 in 0.414s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03d46d7-5a17-411a-9149-eb52f0915f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f2bae-7605-4617-9efd-8bb5018701f7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:38 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c Sep 03 13:51:38 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:38 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c" returned: 0 in 0.528s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:38 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 Sep 03 13:51:38 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (b5d0ca53-aedc-40ce-8303-97511cb596c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a71157-7e8a-4735-92e8-69e3470ddacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a71157-7e8a-4735-92e8-69e3470ddacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303605924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5aa5f6-20a1-4d68-8214-d1258d8b94d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:39Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d0342b-4266-4b0b-9de3-ad5b3f2f373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d0342b-4266-4b0b-9de3-ad5b3f2f373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b11e7a-3a5b-4d1f-aad9-697dda4611ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b11e7a-3a5b-4d1f-aad9-697dda4611ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5aa5f6-20a1-4d68-8214-d1258d8b94d5', 'volume_name': 'volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b46479b-121b-48c2-b917-55d3b717fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b46479b-121b-48c2-b917-55d3b717fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4ff910-2fbd-408a-bc23-3cd599317ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Volume ba5aa5f6-20a1-4d68-8214-d1258d8b94d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5', 'volume_size': 1} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303605924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5aa5f6-20a1-4d68-8214-d1258d8b94d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:39Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Creating volume ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:39 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:39 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 1073741824 Sep 03 13:51:39 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Flow 'volume_create_manager' (135e428f-7794-4ae1-922b-fae5b3782b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e8048c-33b6-4af5-8210-8eb71ac5559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e8048c-33b6-4af5-8210-8eb71ac5559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914376071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5e8bb1-1f49-47af-b5b7-f37842d03af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d162701e1f4d869e88ebb6032200a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:39Z,use_quota=True,user_id='6c2edc2cc60047bd9f274ba850a18346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c06340-a9ec-4722-903e-3515a1262aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c06340-a9ec-4722-903e-3515a1262aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1397b2-8a66-491a-9d1b-375d7d58dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1397b2-8a66-491a-9d1b-375d7d58dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5e8bb1-1f49-47af-b5b7-f37842d03af7', 'volume_name': 'volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9b9a9d-e113-463d-b85a-19a9d0e954a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9b9a9d-e113-463d-b85a-19a9d0e954a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fbd0b2-6a36-4625-b274-1cf40e2bff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:39 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Volume bf5e8bb1-1f49-47af-b5b7-f37842d03af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7', 'volume_size': 1} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856" returned: 0 in 0.522s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:39 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856 Sep 03 13:51:39 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:39 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 1073741824" returned: 0 in 0.515s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:39 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c.14723777-e7f7-4779-ad27-30dc6e495856" returned: 0 in 0.279s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:39 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 Sep 03 13:51:39 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-14723777-e7f7-4779-ad27-30dc6e495856" released by "_delete_snapshot" :: held 1.883s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" released by "delete_snapshot" :: held 1.909s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['bccfcad3-3442-46c9-890e-7e10ff0fb129', '465eb248-548a-4503-a03d-5dfb01753c8c', '23c292eb-60d8-4154-86a0-a8fad3a4b457', '1fb46269-5713-48f0-bf2a-e94d771b165b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Delete snapshot completed successfully. Sep 03 13:51:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2f40bb60-f9be-4758-b21d-936b3c16a3e7 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-14723777-e7f7-4779-ad27-30dc6e495856-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:40 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914376071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5e8bb1-1f49-47af-b5b7-f37842d03af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d162701e1f4d869e88ebb6032200a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:39Z,use_quota=True,user_id='6c2edc2cc60047bd9f274ba850a18346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Creating volume bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:40 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-e03d46d7-5a17-411a-9149-eb52f0915f8c-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:40 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 1073741824 Sep 03 13:51:40 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4ff910-2fbd-408a-bc23-3cd599317ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143cc467-d524-419f-b137-9efea39aba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-e03d46d7-5a17-411a-9149-eb52f0915f8c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Volume volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 (ba5aa5f6-20a1-4d68-8214-d1258d8b94d5): created successfully Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143cc467-d524-419f-b137-9efea39aba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (b5d0ca53-aedc-40ce-8303-97511cb596c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b74d3e32-9ad5-46eb-b920-e7dbe37e7562 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef724d1-261c-4e37-891d-3328c8914c4a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:40 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c Sep 03 13:51:40 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:40 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 1073741824" returned: 0 in 0.480s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:40 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 Sep 03 13:51:40 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:40 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c" returned: 0 in 0.423s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:40 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c Sep 03 13:51:40 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:40 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fbd0b2-6a36-4625-b274-1cf40e2bff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d65b82e-e4c6-4de8-bb03-be9a86d33b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Volume volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 (bf5e8bb1-1f49-47af-b5b7-f37842d03af7): created successfully Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d65b82e-e4c6-4de8-bb03-be9a86d33b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Flow 'volume_create_manager' (135e428f-7794-4ae1-922b-fae5b3782b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d42ddcba-8f39-4bb3-ad31-e989ef21aec0 tempest-CinderUnicodeTest-909276488 None] Created volume successfully. Sep 03 13:51:40 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e03d46d7-5a17-411a-9149-eb52f0915f8c" returned: 0 in 0.292s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-quobyte-e03d46d7-5a17-411a-9149-eb52f0915f8c" released by "delete_volume" :: held 0.783s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Created reservations ['7bb9b333-408a-4024-933d-242f122945ce', '24224834-b1a9-4af4-9157-74aa727bbe58', 'c198903d-ee7e-4a9f-be0a-e4cf9217433a', 'b746fd61-c6cb-4066-8c92-ce9280200a1d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:41 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:41 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:41 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.272s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:41 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Deleted volume successfully. Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12675f53-9778-41fb-ac3a-c8d314ddf609 tempest-CreateVolumesFromSnapshotTest-1402411749 None] Lock "cinder-e03d46d7-5a17-411a-9149-eb52f0915f8c-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Creating offline snapshot b7cafc73-0a1a-4db4-9d55-6bc34eec2332 of volume ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444ec7d-1cec-49d4-a50a-f19d84173f65]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:41 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 Sep 03 13:51:41 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (31a682d1-1522-4737-9754-a089829dfa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a471d62a-d6df-4182-b463-759f9cd9fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a471d62a-d6df-4182-b463-759f9cd9fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034035457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44136d0-784c-49d7-8df3-a9cf5a4a0262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:42Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4a015e-b2bf-4609-8d5b-1398cf3b8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4a015e-b2bf-4609-8d5b-1398cf3b8715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a253efca-13e8-4ea5-9629-8162f7a57ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a253efca-13e8-4ea5-9629-8162f7a57ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44136d0-784c-49d7-8df3-a9cf5a4a0262', 'volume_name': 'volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264aa416-5abd-4206-b3a5-c553cb850c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264aa416-5abd-4206-b3a5-c553cb850c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf4a2d7-e16e-4d24-bf0e-c197c2f62e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:41 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Volume b44136d0-784c-49d7-8df3-a9cf5a4a0262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262', 'volume_size': 1} Sep 03 13:51:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:42 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" returned: 0 in 0.514s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:42 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 1G Sep 03 13:51:42 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:42 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 1G" returned: 0 in 0.506s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:42 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 Sep 03 13:51:42 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:42 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:42 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 is being set with open permissions: ugo+rw Sep 03 13:51:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:43 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 Sep 03 13:51:43 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:43 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332" returned: 0 in 0.256s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:43 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info Sep 03 13:51:43 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:43 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:43 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info is being set with open permissions: ugo+rw Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:43 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info Sep 03 13:51:43 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:43 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.info" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.852s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034035457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44136d0-784c-49d7-8df3-a9cf5a4a0262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:42Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Creating volume b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:43 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:43 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 1073741824 Sep 03 13:51:43 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-be32f288-e183-4026-90b3-982cf21cd6cc tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:51:44 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 1073741824" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:44 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 Sep 03 13:51:44 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:44 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262" returned: 0 in 0.248s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.557s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Creating offline snapshot 9567307e-2d77-4c43-aa26-77af161d6798 of volume bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf4a2d7-e16e-4d24-bf0e-c197c2f62e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a2dff5-b23e-4da5-918e-f054faf28b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b584459-f6c4-4453-993d-70ece3a80fd7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Volume volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 (b44136d0-784c-49d7-8df3-a9cf5a4a0262): created successfully Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a2dff5-b23e-4da5-918e-f054faf28b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (31a682d1-1522-4737-9754-a089829dfa0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:44 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-36e2dcad-ba58-4299-8a17-25a64b7f9d18 tempest-ProjectReaderTests-727263789 None] Created volume successfully. Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (206fd8a1-de31-4e96-8481-efd4cef77843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb97a510-5093-4386-9433-3d86e28644fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb97a510-5093-4386-9433-3d86e28644fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810146466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c58b7-11f3-4a9a-8b97-d2b217a42638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:45Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e65cb38-0eba-45b7-8b35-fddc3c0e0ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 Sep 03 13:51:44 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e65cb38-0eba-45b7-8b35-fddc3c0e0ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e3fef2-150c-49c2-9864-3a3795361f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e3fef2-150c-49c2-9864-3a3795361f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65c58b7-11f3-4a9a-8b97-d2b217a42638', 'volume_name': 'volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7327ce2b-739a-4226-91fa-808a4cab95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7327ce2b-739a-4226-91fa-808a4cab95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f918df-3f7e-4056-b1e3-5c7a49987e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume e65c58b7-11f3-4a9a-8b97-d2b217a42638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638', 'volume_size': 1} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-b7cafc73-0a1a-4db4-9d55-6bc34eec2332-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-b7cafc73-0a1a-4db4-9d55-6bc34eec2332-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-b7cafc73-0a1a-4db4-9d55-6bc34eec2332" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b7cafc73-0a1a-4db4-9d55-6bc34eec2332" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot b7cafc73-0a1a-4db4-9d55-6bc34eec2332 of volume ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cbef2f-4017-4cf2-ba22-21789eeb6f01]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:44 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" returned: 0 in 0.364s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:45 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 1G Sep 03 13:51:45 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:45 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 Sep 03 13:51:45 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:45 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b96a44-f835-4f9e-83af-16d8e6fad740]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:45 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 1G" returned: 0 in 0.471s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:45 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 Sep 03 13:51:45 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:45 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 Sep 03 13:51:45 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:45 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:45 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 is being set with open permissions: ugo+rw Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:45 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" returned: 0 in 0.375s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:45 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 Sep 03 13:51:45 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:45 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 Sep 03 13:51:45 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:46 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798" returned: 0 in 0.258s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:46 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info Sep 03 13:51:46 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:46 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332" returned: 0 in 0.353s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:46 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332 Sep 03 13:51:46 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:46 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:46 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info is being set with open permissions: ugo+rw Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:46 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info Sep 03 13:51:46 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:46 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5.b7cafc73-0a1a-4db4-9d55-6bc34eec2332" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b7cafc73-0a1a-4db4-9d55-6bc34eec2332" released by "_delete_snapshot" :: held 1.506s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" released by "delete_snapshot" :: held 1.537s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Created reservations ['b845de31-1770-4a9e-a831-ee7a732ff5ec', '60a7a127-67eb-4be3-9598-13733e358abf', 'f64c599f-ce3c-4ce4-8e3d-fdf23a836dec', '1db0c2b3-a1da-4885-9d98-03321e75aaa4'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-c6bcfe41-6e4f-411a-8232-7f5b96adfc3d tempest-ProjectMemberTests-669573642 None] Lock "cinder-b7cafc73-0a1a-4db4-9d55-6bc34eec2332-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:46 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.info" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810146466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c58b7-11f3-4a9a-8b97-d2b217a42638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:45Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume e65c58b7-11f3-4a9a-8b97-d2b217a42638 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:46 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:46 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:46 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 1073741824 Sep 03 13:51:46 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:46 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0a703117-bb13-4abd-b6a4-1ff526b83948 tempest-CinderUnicodeTest-909276488 None] Create snapshot completed successfully Sep 03 13:51:47 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 1073741824" returned: 0 in 0.424s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "cinder-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:47 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 Sep 03 13:51:47 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c2102-deb3-4755-be15-6fb035b499b6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-9567307e-2d77-4c43-aa26-77af161d6798-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:47 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 Sep 03 13:51:47 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-9567307e-2d77-4c43-aa26-77af161d6798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-quobyte-9567307e-2d77-4c43-aa26-77af161d6798" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-9567307e-2d77-4c43-aa26-77af161d6798" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Deleting offline snapshot 9567307e-2d77-4c43-aa26-77af161d6798 of volume bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:47 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] snapshot_file for this snap is: volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638" returned: 0 in 0.308s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.176s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb24586-27e6-4d62-983b-8ad13e27c918]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f918df-3f7e-4056-b1e3-5c7a49987e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fb6da4-2144-4563-bb2b-a1cd7bbe75f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Creating offline snapshot 8d0c1369-24e4-4295-8690-83c11cebecc2 of volume b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:47 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 (e65c58b7-11f3-4a9a-8b97-d2b217a42638): created successfully Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fb6da4-2144-4563-bb2b-a1cd7bbe75f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (206fd8a1-de31-4e96-8481-efd4cef77843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cbe0cd-d638-4878-b692-e26fefcf40ae]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-96274a76-8d59-4c48-b335-734e20260021 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:47 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 Sep 03 13:51:47 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" returned: 0 in 0.424s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 Sep 03 13:51:47 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5 Sep 03 13:51:47 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1a9ba-d65a-42f5-bb99-0eb363b8d903]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5" released by "delete_volume" :: held 0.799s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:47 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 1G Sep 03 13:51:47 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 Sep 03 13:51:47 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:47 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Created reservations ['1c310bf0-7a19-464f-8d90-3260c70a3faf', 'b3b9e3ab-d8b9-49bc-a46d-8a4547cbdaf3', '8b8a7b18-6cdd-4649-831a-9ef3cf9f9b31', 'eab81467-a9c5-471e-b3c7-c2080cbead1b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:48 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:48 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:48 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" returned: 0 in 0.505s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:48 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 Sep 03 13:51:48 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:48 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (5d92458f-41fe-49cc-b36a-2e1f236fb2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e0868b-88b5-4ac6-b769-cfb44f26227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.439s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e0868b-88b5-4ac6-b769-cfb44f26227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124475250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0469c942-bece-4b73-92f9-2f7b8e8e755e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:48Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae66116-9e0d-4011-ab08-4865e03ae1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:48 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae66116-9e0d-4011-ab08-4865e03ae1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6990cd-078d-4bec-806f-6b8945fae2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6990cd-078d-4bec-806f-6b8945fae2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0469c942-bece-4b73-92f9-2f7b8e8e755e', 'volume_name': 'volume-0469c942-bece-4b73-92f9-2f7b8e8e755e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d9c05-45fb-45a0-a4c7-7f8c7616ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d9c05-45fb-45a0-a4c7-7f8c7616ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89169bb5-058f-4e6a-81fd-53061a5d3511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:48 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume 0469c942-bece-4b73-92f9-2f7b8e8e755e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0469c942-bece-4b73-92f9-2f7b8e8e755e', 'volume_size': 1} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:48 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 1G" returned: 0 in 0.715s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:48 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 Sep 03 13:51:48 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-927930c0-8244-4c92-8d9b-e3b5416bac5c tempest-ProjectMemberTests-669573642 None] Lock "cinder-ba5aa5f6-20a1-4d68-8214-d1258d8b94d5-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:48 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798" returned: 0 in 0.546s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:48 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:48 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798 Sep 03 13:51:48 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:49 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (f31adddd-e5c8-45bd-8a25-9df4a92d8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c236a4-ab22-497f-95f4-f241fa0a642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2" returned: 0 in 0.449s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:49 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 is being set with open permissions: ugo+rw Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c236a4-ab22-497f-95f4-f241fa0a642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849257860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bb5a75-0103-4199-aca2-edccb7521d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdab336-7d37-469c-96dd-153f9a4cec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdab336-7d37-469c-96dd-153f9a4cec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 Sep 03 13:51:49 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b1dbbc-4f7d-41c6-b8d3-bcdb3c475247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b1dbbc-4f7d-41c6-b8d3-bcdb3c475247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bb5a75-0103-4199-aca2-edccb7521d32', 'volume_name': 'volume-f9bb5a75-0103-4199-aca2-edccb7521d32', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102948dd-e420-4d52-931c-9b4bdb30f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102948dd-e420-4d52-931c-9b4bdb30f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ebe9fa-c2bd-4c1d-b404-0779c70dc49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Volume f9bb5a75-0103-4199-aca2-edccb7521d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bb5a75-0103-4199-aca2-edccb7521d32', 'volume_size': 1} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:49 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (0be28686-1f8e-43f9-853b-a9aeff571596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7f901e-4c48-47e7-8ce7-fdc9765ec3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7.9567307e-2d77-4c43-aa26-77af161d6798" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7f901e-4c48-47e7-8ce7-fdc9765ec3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824573587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d59e23-72c7-4e3d-b5f1-bc81de7e9629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80662edd-a6b6-4dca-81d3-c19f4b42949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80662edd-a6b6-4dca-81d3-c19f4b42949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6634800e-783e-4486-9948-ca3ce275cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6634800e-783e-4486-9948-ca3ce275cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d59e23-72c7-4e3d-b5f1-bc81de7e9629', 'volume_name': 'volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8700ca77-d034-4d01-bc7a-eb5dfccd37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8700ca77-d034-4d01-bc7a-eb5dfccd37b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd5fd7d-03ba-4491-8caa-34357a2bcaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume f8d59e23-72c7-4e3d-b5f1-bc81de7e9629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629', 'volume_size': 1} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-9567307e-2d77-4c43-aa26-77af161d6798" released by "_delete_snapshot" :: held 1.984s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" released by "delete_snapshot" :: held 2.030s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Created reservations ['0d6bb4b4-525d-4d7a-8e89-78e0e6be7b0b', '25076864-d2de-426a-a83a-a65ef86a5c18', 'c9d4d85f-0e1c-477f-b9b7-5f0f638d33cc', 'c748b8ea-aba2-4536-95cf-9c9220280e47'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:49 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:49 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info Sep 03 13:51:49 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (e09553c9-92fd-42b5-a536-78ea7f238e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4dd42e-95a5-466a-a999-1cb7a456022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4dd42e-95a5-466a-a999-1cb7a456022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870085660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca767e2-8eba-4826-abe0-dd96660c0b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404a0baf-bd12-434d-bb68-bf70f7288cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404a0baf-bd12-434d-bb68-bf70f7288cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6311afef-30de-4149-8b5c-9134b0e69937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6311afef-30de-4149-8b5c-9134b0e69937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca767e2-8eba-4826-abe0-dd96660c0b92', 'volume_name': 'volume-bca767e2-8eba-4826-abe0-dd96660c0b92', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defe2355-bb52-45dd-a073-775339630eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defe2355-bb52-45dd-a073-775339630eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee47c27-4827-41bd-8200-be9255a816ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:49 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume bca767e2-8eba-4826-abe0-dd96660c0b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca767e2-8eba-4826-abe0-dd96660c0b92', 'volume_size': 1} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:49 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Delete snapshot completed successfully. Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e315f97a-09d8-4374-bf01-7e7bf2106a72 tempest-CinderUnicodeTest-909276488 None] Lock "cinder-9567307e-2d77-4c43-aa26-77af161d6798-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:49 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info" returned: 0 in 0.318s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:49 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info is being set with open permissions: ugo+rw Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-bf5e8bb1-1f49-47af-b5b7-f37842d03af7-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:49 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info Sep 03 13:51:49 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "cinder-bf5e8bb1-1f49-47af-b5b7-f37842d03af7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:49 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36828c5a-16b6-4d7d-9cd3-64f24b6248c7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:50 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (adbd0121-e8c6-430c-8ec8-7f50b85ffb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0febcef-d9e7-4514-b56f-d0add8ca21a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.info" returned: 0 in 0.326s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124475250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0469c942-bece-4b73-92f9-2f7b8e8e755e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:48Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume 0469c942-bece-4b73-92f9-2f7b8e8e755e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:50 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:50 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:50 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0febcef-d9e7-4514-b56f-d0add8ca21a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88528746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cba1ff-1b07-429a-9548-2873d2570416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:50Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e 1073741824 Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164a771a-8e75-4fa9-84c5-55c49b0de1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164a771a-8e75-4fa9-84c5-55c49b0de1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d3117-43bc-4f54-b283-3092b6597553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d3117-43bc-4f54-b283-3092b6597553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28cba1ff-1b07-429a-9548-2873d2570416', 'volume_name': 'volume-28cba1ff-1b07-429a-9548-2873d2570416', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c7783e-cb00-4fbe-87f0-e6b52c5a9e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c7783e-cb00-4fbe-87f0-e6b52c5a9e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9b8d6a-57e3-4198-a213-c1bd7ff63eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume 28cba1ff-1b07-429a-9548-2873d2570416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28cba1ff-1b07-429a-9548-2873d2570416', 'volume_size': 1} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:50 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-426d51b4-8ffb-4004-9118-cb5a7d4f93e7 tempest-ProjectReaderTests-727263789 None] Create snapshot completed successfully Sep 03 13:51:50 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" returned: 0 in 0.418s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:50 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7 Sep 03 13:51:50 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (b1a8d744-21c6-4a8f-9389-d26fd458733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f38802b-1d52-44ee-b3ba-a4efcef6f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f38802b-1d52-44ee-b3ba-a4efcef6f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583369058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbf23cd-b8df-42f0-9866-ca7251d9db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:50Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f897d154-8ad5-434b-9b17-484af6cb7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f897d154-8ad5-434b-9b17-484af6cb7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba03d7e8-e30d-446c-831d-16bfb89a9675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba03d7e8-e30d-446c-831d-16bfb89a9675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbf23cd-b8df-42f0-9866-ca7251d9db0e', 'volume_name': 'volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d968e-a357-41a6-8520-b8f290c741b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d968e-a357-41a6-8520-b8f290c741b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62239b9e-eb5b-401c-8015-b9fd1aec740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:50 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume adbf23cd-b8df-42f0-9866-ca7251d9db0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e', 'volume_size': 1} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:50 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e 1073741824" returned: 0 in 0.486s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:50 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e Sep 03 13:51:50 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:50 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" returned: 0 in 0.294s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-bf5e8bb1-1f49-47af-b5b7-f37842d03af7" released by "delete_volume" :: held 0.812s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Created reservations ['4d1a1976-8f66-4ff5-914c-01a62c1bc634', 'af568465-87eb-42c3-aaba-652cb724731b', 'a979d691-7cb3-49c5-b189-cff62f8a93e9', 'e5a40b3a-7df4-40a2-818e-16e4fee9b6e8'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:50 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:50 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:50 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e" returned: 0 in 0.284s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849257860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bb5a75-0103-4199-aca2-edccb7521d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Creating volume f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:50 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-8d0c1369-24e4-4295-8690-83c11cebecc2-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:51 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 1073741824 Sep 03 13:51:51 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89169bb5-058f-4e6a-81fd-53061a5d3511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0469c942-bece-4b73-92f9-2f7b8e8e755e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd5f098-22d4-4e0a-89d6-d9988f636b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-8d0c1369-24e4-4295-8690-83c11cebecc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-0469c942-bece-4b73-92f9-2f7b8e8e755e (0469c942-bece-4b73-92f9-2f7b8e8e755e): created successfully Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd5f098-22d4-4e0a-89d6-d9988f636b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (5d92458f-41fe-49cc-b36a-2e1f236fb2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-8d0c1369-24e4-4295-8690-83c11cebecc2" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-ef966d2e-947f-43fb-b59e-65fbccdb3656-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f7ba2b6f-8a0f-473b-98f8-02449d3b3912 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-8d0c1369-24e4-4295-8690-83c11cebecc2" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Deleting offline snapshot 8d0c1369-24e4-4295-8690-83c11cebecc2 of volume b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] snapshot_file for this snap is: volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "cinder-ef966d2e-947f-43fb-b59e-65fbccdb3656-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f113a4-fb3c-4101-b97f-31649ecc553a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Acquiring lock "cinder-quobyte-ef966d2e-947f-43fb-b59e-65fbccdb3656" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:51 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.373s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Deleted volume successfully. Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-ef966d2e-947f-43fb-b59e-65fbccdb3656" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-9ed1d56f-dbfe-47a3-b666-d053bb86201e tempest-CinderUnicodeTest-909276488 None] Lock "cinder-bf5e8bb1-1f49-47af-b5b7-f37842d03af7-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f73d5e-dcf5-46ef-a7b3-8b56f03e0d66]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 Sep 03 13:51:51 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 Sep 03 13:51:51 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 1073741824" returned: 0 in 0.500s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 Sep 03 13:51:51 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2" returned: 0 in 0.424s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39e025-4ead-4b90-a053-dd57e02993db]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656" returned: 0 in 0.407s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656 Sep 03 13:51:51 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 Sep 03 13:51:51 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32" returned: 0 in 0.278s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.534s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824573587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d59e23-72c7-4e3d-b5f1-bc81de7e9629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ebe9fa-c2bd-4c1d-b404-0779c70dc49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bb5a75-0103-4199-aca2-edccb7521d32', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3be124-07c8-4092-b1f3-cb9d6bd18f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:51 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 1073741824 Sep 03 13:51:51 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Volume volume-f9bb5a75-0103-4199-aca2-edccb7521d32 (f9bb5a75-0103-4199-aca2-edccb7521d32): created successfully Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3be124-07c8-4092-b1f3-cb9d6bd18f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (f31adddd-e5c8-45bd-8a25-9df4a92d8bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6749c8c5-6e03-4b6c-9415-78df6eedaebb tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:51:52 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ef966d2e-947f-43fb-b59e-65fbccdb3656" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "cinder-quobyte-ef966d2e-947f-43fb-b59e-65fbccdb3656" released by "delete_volume" :: held 0.751s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:52 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262" returned: 0 in 0.408s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:52 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 Sep 03 13:51:52 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Created reservations ['76e92119-f26b-43bd-94a7-a98ce6157743', '3cc4ade7-9582-4eec-826a-d983c613c9d2', 'a6165958-b416-477a-91ae-03c139569c09', '98d32629-458c-4172-bd0c-095c5d9704a3'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:52 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:52 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:52 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 1073741824" returned: 0 in 0.608s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:52 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2" returned: 0 in 0.467s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:52 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 Sep 03 13:51:52 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:52 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2 Sep 03 13:51:52 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:52 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.350s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Deleted volume successfully. Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-bad6010b-9aa3-4816-83a4-f9ac89d1204a tempest-CinderUnicodeTest-909276488 None] Lock "cinder-ef966d2e-947f-43fb-b59e-65fbccdb3656-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:52 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" returned: 0 in 0.294s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.208s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870085660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca767e2-8eba-4826-abe0-dd96660c0b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:49Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume bca767e2-8eba-4826-abe0-dd96660c0b92 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:52 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd5fd7d-03ba-4491-8caa-34357a2bcaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266b17e2-8776-42f7-b7f4-4d3c0e2dc6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:52 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:52 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 1073741824 Sep 03 13:51:52 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262.8d0c1369-24e4-4295-8690-83c11cebecc2" returned: 0 in 0.321s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:52 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 (f8d59e23-72c7-4e3d-b5f1-bc81de7e9629): created successfully Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266b17e2-8776-42f7-b7f4-4d3c0e2dc6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (0be28686-1f8e-43f9-853b-a9aeff571596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-8d0c1369-24e4-4295-8690-83c11cebecc2" released by "_delete_snapshot" :: held 1.757s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" released by "delete_snapshot" :: held 1.801s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:52 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-96276981-f9a8-4676-accc-afaf37c59f88 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:52 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Created reservations ['72c543d4-6720-4fa3-b866-bc730ebf3649', 'c41ea661-b28b-449f-bf13-6851391c40ea', 'bcd2f89b-9a6e-4b7e-babc-8ce8eaf23400', '701a557a-4f9b-4c50-828f-9758f8040397'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Delete snapshot completed successfully. Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-12e93b61-647f-41dc-82e3-98beb8f078a7 tempest-ProjectReaderTests-727263789 None] Lock "cinder-8d0c1369-24e4-4295-8690-83c11cebecc2-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-b44136d0-784c-49d7-8df3-a9cf5a4a0262-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "cinder-b44136d0-784c-49d7-8df3-a9cf5a4a0262-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff8e8d6-fa88-41a4-b3af-4308366f3597]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:53 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 1073741824" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:53 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 Sep 03 13:51:53 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:53 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 Sep 03 13:51:53 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:53 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262" returned: 0 in 0.418s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:53 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262 Sep 03 13:51:53 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:53 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92" returned: 0 in 0.354s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.553s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88528746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cba1ff-1b07-429a-9548-2873d2570416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:50Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume 28cba1ff-1b07-429a-9548-2873d2570416 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:53 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:53 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 1073741824 Sep 03 13:51:53 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee47c27-4827-41bd-8200-be9255a816ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca767e2-8eba-4826-abe0-dd96660c0b92', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2b029d-8b7b-4fba-b915-738818b6f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:53 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-bca767e2-8eba-4826-abe0-dd96660c0b92 (bca767e2-8eba-4826-abe0-dd96660c0b92): created successfully Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2b029d-8b7b-4fba-b915-738818b6f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:53 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (e09553c9-92fd-42b5-a536-78ea7f238e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f4bcccaa-efa5-4146-be2b-ae9498ae7b58 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:54 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b44136d0-784c-49d7-8df3-a9cf5a4a0262" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-b44136d0-784c-49d7-8df3-a9cf5a4a0262" released by "delete_volume" :: held 0.773s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Created reservations ['e9b308bb-02fb-41c7-bc74-b28096703dfe', 'de60dc60-287a-4d9b-b69e-cdf2604b9507', '8899bb5f-0be3-498d-bfa5-40f01d19bf05', '33cfa75b-baee-4405-a04a-97c3f7348b06'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:54 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:54 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:54 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 1073741824" returned: 0 in 0.563s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:54 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 Sep 03 13:51:54 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:54 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Deleted volume successfully. Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8f154f99-7a41-4c83-b217-57d4d73309e3 tempest-ProjectReaderTests-727263789 None] Lock "cinder-b44136d0-784c-49d7-8df3-a9cf5a4a0262-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:54 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416" returned: 0 in 0.288s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583369058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbf23cd-b8df-42f0-9866-ca7251d9db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785843cd634d49a9a7af5808526bb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:50Z,use_quota=True,user_id='9e48cca969b14b8698122cdd0ab2fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Creating volume adbf23cd-b8df-42f0-9866-ca7251d9db0e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:54 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:54 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e 1073741824 Sep 03 13:51:54 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9b8d6a-57e3-4198-a213-c1bd7ff63eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28cba1ff-1b07-429a-9548-2873d2570416', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c0a94-acb6-47b7-8ff8-4b015df34d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:54 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-28cba1ff-1b07-429a-9548-2873d2570416 (28cba1ff-1b07-429a-9548-2873d2570416): created successfully Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c0a94-acb6-47b7-8ff8-4b015df34d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:54 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (adbd0121-e8c6-430c-8ec8-7f50b85ffb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-9ec72dc6-ff66-4ebd-808e-6d49e44ac2c9 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (a83fbd81-fc2f-4a2f-8677-d68121c39beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7050a3be-8edf-4393-b7b9-1066b8904f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7050a3be-8edf-4393-b7b9-1066b8904f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121945326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01128696-b2d2-4389-a77c-69dc6ec2ea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:55Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d8c6a-626d-49ea-99ed-2c3f2b405506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d8c6a-626d-49ea-99ed-2c3f2b405506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fe3657-e2cc-4727-82f8-7b4d6219681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fe3657-e2cc-4727-82f8-7b4d6219681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01128696-b2d2-4389-a77c-69dc6ec2ea7f', 'volume_name': 'volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0068fb-e47a-4696-b8e5-13d02d7ccf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0068fb-e47a-4696-b8e5-13d02d7ccf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7175691e-20d7-4a34-a32c-cf598a118da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Volume 01128696-b2d2-4389-a77c-69dc6ec2ea7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f', 'volume_size': 1} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:55 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e 1073741824" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:55 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e Sep 03 13:51:55 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:55 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e" returned: 0 in 0.257s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.199s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62239b9e-eb5b-401c-8015-b9fd1aec740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e92915a-4354-48d5-8b8a-4081a64c650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 7b183afe-1ec8-41a7-a104-e1a78f48cb83 of volume f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:55 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Volume volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e (adbf23cd-b8df-42f0-9866-ca7251d9db0e): created successfully Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e92915a-4354-48d5-8b8a-4081a64c650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Flow 'volume_create_manager' (b1a8d744-21c6-4a8f-9389-d26fd458733b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdbb2c-871d-4955-9f49-51e3e5b7180e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e9e566f8-605d-4932-a018-b2926ee1f718 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created volume successfully. Sep 03 13:51:55 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 Sep 03 13:51:55 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32" returned: 0 in 0.384s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:56 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 1G Sep 03 13:51:56 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-adbf23cd-b8df-42f0-9866-ca7251d9db0e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-adbf23cd-b8df-42f0-9866-ca7251d9db0e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-adbf23cd-b8df-42f0-9866-ca7251d9db0e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-adbf23cd-b8df-42f0-9866-ca7251d9db0e" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91f6fb-1136-45bc-afff-59970559a45c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:56 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e Sep 03 13:51:56 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 1G" returned: 0 in 0.481s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9bb5a75-0103-4199-aca2-edccb7521d32 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:56 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9bb5a75-0103-4199-aca2-edccb7521d32 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 Sep 03 13:51:56 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:56 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e Sep 03 13:51:56 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9bb5a75-0103-4199-aca2-edccb7521d32 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83" returned: 0 in 0.348s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:56 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 is being set with open permissions: ugo+rw Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:56 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 Sep 03 13:51:56 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:56 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-adbf23cd-b8df-42f0-9866-ca7251d9db0e" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-adbf23cd-b8df-42f0-9866-ca7251d9db0e" released by "delete_volume" :: held 0.769s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['703c2634-e80e-4e0c-9a12-1d04dfc66f84', '2867826a-f6d0-4d45-85f6-9304d4b950ed', '6ea17f5f-300a-4770-859c-b114bfb50de5', 'e933174a-59d5-438e-afcf-9da599986790'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:57 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83" returned: 0 in 0.294s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:57 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info Sep 03 13:51:57 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:57 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:57 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-28cba1ff-1b07-429a-9548-2873d2570416-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-28cba1ff-1b07-429a-9548-2873d2570416-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-28cba1ff-1b07-429a-9548-2873d2570416" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-28cba1ff-1b07-429a-9548-2873d2570416" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:57 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info" returned: 0 in 0.336s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:57 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info is being set with open permissions: ugo+rw Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[377a6aa0-0c81-4aa3-b152-7a8fec1d4fda]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:57 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info Sep 03 13:51:57 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:57 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.399s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-861a8e6d-3e24-4adf-8ed8-36957dee72ab tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-adbf23cd-b8df-42f0-9866-ca7251d9db0e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:57 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 Sep 03 13:51:57 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:57 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.info" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.672s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121945326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01128696-b2d2-4389-a77c-69dc6ec2ea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:51:55Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Creating volume 01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:51:57 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:51:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:57 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f 1073741824 Sep 03 13:51:57 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2c734698-6d34-4c31-86fd-e1e3c95f4b5a tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:51:57 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:58 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416 Sep 03 13:51:58 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:58 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-28cba1ff-1b07-429a-9548-2873d2570416" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-28cba1ff-1b07-429a-9548-2873d2570416" released by "delete_volume" :: held 0.780s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['6afdf593-dd78-46c0-8494-e219e0354002', 'ece71897-57ac-4f8f-a29a-ab21f7612710', '8c2cc67f-27a1-476b-a756-bffab7b6c2bc', '5fb3b28a-31f9-468f-8acf-89e41c036e55'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:58 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f 1073741824" returned: 0 in 0.481s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:51:58 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f Sep 03 13:51:58 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:58 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:51:58 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-bca767e2-8eba-4826-abe0-dd96660c0b92-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:58 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-7b183afe-1ec8-41a7-a104-e1a78f48cb83-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:58 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.331s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-bca767e2-8eba-4826-abe0-dd96660c0b92-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f" returned: 0 in 0.394s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-7b183afe-1ec8-41a7-a104-e1a78f48cb83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7175691e-20d7-4a34-a32c-cf598a118da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e01302-b383-4b7f-9941-7cd41684379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1f296c77-9faf-4d5c-9387-2fe77a26a395 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-28cba1ff-1b07-429a-9548-2873d2570416-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-7b183afe-1ec8-41a7-a104-e1a78f48cb83" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-bca767e2-8eba-4826-abe0-dd96660c0b92" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:51:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Volume volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f (01128696-b2d2-4389-a77c-69dc6ec2ea7f): created successfully Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e01302-b383-4b7f-9941-7cd41684379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (a83fbd81-fc2f-4a2f-8677-d68121c39beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-7b183afe-1ec8-41a7-a104-e1a78f48cb83" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 7b183afe-1ec8-41a7-a104-e1a78f48cb83 of volume f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-bca767e2-8eba-4826-abe0-dd96660c0b92" acquired by "delete_volume" :: waited 0.051s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8d10c-170b-480d-a7c4-c1bc0d8b85aa]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe9801-f403-4fcb-b65b-12a398b9def2]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f46611f3-95f7-4c55-a1d4-f4ec226d0fff tempest-ProjectReaderTests-727263789 None] Created volume successfully. Sep 03 13:51:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:59 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 Sep 03 13:51:59 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:59 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 Sep 03 13:51:59 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:59 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83" returned: 0 in 0.432s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9bb5a75-0103-4199-aca2-edccb7521d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:51:59 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92" returned: 0 in 0.433s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2e391-af83-4705-abdb-307ae8cc3a89]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:59 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92 Sep 03 13:51:59 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:59 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 Sep 03 13:51:59 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:51:59 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bca767e2-8eba-4826-abe0-dd96660c0b92" returned: 0 in 0.313s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-bca767e2-8eba-4826-abe0-dd96660c0b92" released by "delete_volume" :: held 0.815s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['74bddc88-94bc-4ebd-bc2a-3fec4483eb07', '8a4030e7-232c-46c4-874c-36ad336d8932', '4e2ebc34-12f8-48a5-896a-7c25ab73f29d', '612c2ac3-c5c3-495a-949a-8072efa614e0'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:51:59 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Creating offline snapshot f2bbd586-954c-49ec-9851-98bc6dcec0ef of volume 01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32" returned: 0 in 0.500s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a5a3b2-7eb1-4c44-a9e8-d32d51f23deb]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:51:59 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:51:59 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 Sep 03 13:51:59 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:00 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:00 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f Sep 03 13:52:00 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83" returned: 0 in 0.385s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:00 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83 Sep 03 13:52:00 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:00 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f" returned: 0 in 0.411s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.337s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:00 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:52:00 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef 1G Sep 03 13:52:00 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-af10968d-43bc-4a85-a947-8747e2cafcfc tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-bca767e2-8eba-4826-abe0-dd96660c0b92-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:00 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32.7b183afe-1ec8-41a7-a104-e1a78f48cb83" returned: 0 in 0.292s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-7b183afe-1ec8-41a7-a104-e1a78f48cb83" released by "_delete_snapshot" :: held 1.743s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" released by "delete_snapshot" :: held 1.789s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Created reservations ['ba359b35-0fb6-4343-b6c7-352d465f3483', '23668ab8-6ea7-4360-94ce-2b227efa1ce3', '81169736-d406-46ce-9efc-b045fe78feab', '37170e0d-556f-4e9b-8590-4936c5e9b676'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:00 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-84076b53-6062-4d86-a966-4ae1a6bba013 tempest-ProjectMemberTests-669573642 None] Lock "cinder-7b183afe-1ec8-41a7-a104-e1a78f48cb83-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:00 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef 1G" returned: 0 in 0.513s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:00 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef Sep 03 13:52:00 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-f9bb5a75-0103-4199-aca2-edccb7521d32-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:00 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "cinder-f9bb5a75-0103-4199-aca2-edccb7521d32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a63e170-0eaa-461a-96f7-33f9df9a2fcf]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" acquired by "delete_volume" :: waited 0.050s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ad7b7-88ae-42df-963f-73ed9b75805b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 Sep 03 13:52:01 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef is being set with open permissions: ugo+rw Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef Sep 03 13:52:01 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 Sep 03 13:52:01 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32" returned: 0 in 0.435s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32 Sep 03 13:52:01 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" returned: 0 in 0.465s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:01 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info Sep 03 13:52:01 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629 Sep 03 13:52:01 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:01 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f9bb5a75-0103-4199-aca2-edccb7521d32" returned: 0 in 0.326s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f9bb5a75-0103-4199-aca2-edccb7521d32" released by "delete_volume" :: held 0.837s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:01 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info" returned: 0 in 0.339s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info is being set with open permissions: ugo+rw Sep 03 13:52:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:02 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info Sep 03 13:52:02 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Created reservations ['3e87d8dc-1511-4646-8b82-8ce0f66b4812', '17cce3e2-af06-4e00-9cf8-1d94351397f6', 'b659f3be-b2fe-438b-8872-e493462731e7', '0c89844f-f4c3-4ef6-a510-97273ee46683'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:02 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" returned: 0 in 0.341s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629" released by "delete_volume" :: held 0.870s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:02 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:02 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['1a648558-d241-493e-a00b-71d2b154893c', '3135acef-fa4e-45fc-93cc-d8c837d24ed4', 'fd5cbcff-685f-41d7-bec8-dadd3be987ba', '4413e1c8-956e-4cc6-bc25-74b6937b0607'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:02 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.info" returned: 0 in 0.284s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:02 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:02 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-36cfb15e-b0c3-40ee-a527-aef7812cf075 tempest-ProjectReaderTests-727263789 None] Create snapshot completed successfully Sep 03 13:52:02 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-2db7cbc9-a1c2-4c63-8e52-3f2e3fb09578 tempest-ProjectMemberTests-669573642 None] Lock "cinder-f9bb5a75-0103-4199-aca2-edccb7521d32-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:02 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:52:02 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1a37658a-b647-4fae-bdc0-d8389555cacb tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-f8d59e23-72c7-4e3d-b5f1-bc81de7e9629-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-f2bbd586-954c-49ec-9851-98bc6dcec0ef-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-f2bbd586-954c-49ec-9851-98bc6dcec0ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-f2bbd586-954c-49ec-9851-98bc6dcec0ef" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-f2bbd586-954c-49ec-9851-98bc6dcec0ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Deleting offline snapshot f2bbd586-954c-49ec-9851-98bc6dcec0ef of volume 01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] snapshot_file for this snap is: volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f48ad6-6c85-4c8a-ae57-42e65ac617b8]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:03 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef Sep 03 13:52:03 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-0469c942-bece-4b73-92f9-2f7b8e8e755e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-0469c942-bece-4b73-92f9-2f7b8e8e755e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:UPDATE=336,cinder:SELECT=240,cinder:DELETE=25,cinder:INSERT=83 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=242,cinder:UPDATE=304,cinder:INSERT=90,cinder:DELETE=33 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-0469c942-bece-4b73-92f9-2f7b8e8e755e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-0469c942-bece-4b73-92f9-2f7b8e8e755e" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[163775c3-768f-4dea-9553-57629f57e5dc]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:03 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef" returned: 0 in 0.528s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eafe1ff-6108-4870-86eb-47d1267ea2bf]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:03 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e Sep 03 13:52:03 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (a4c16182-5039-450d-a736-cd45898ce549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81b0bb-d99e-4d2f-bb54-33c15595321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81b0bb-d99e-4d2f-bb54-33c15595321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045118167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e161f-c977-49fd-b3f1-78526a4d691d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:04Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9723a62e-01e2-4ed1-922a-25ea178cef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9723a62e-01e2-4ed1-922a-25ea178cef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5611b2-26f8-4d38-8461-6899f5456caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5611b2-26f8-4d38-8461-6899f5456caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89e161f-c977-49fd-b3f1-78526a4d691d', 'volume_name': 'volume-f89e161f-c977-49fd-b3f1-78526a4d691d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa2ddbe-0d65-4cb0-9281-0d4097845999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:03 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f Sep 03 13:52:03 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa2ddbe-0d65-4cb0-9281-0d4097845999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870e93f8-6652-4c50-8111-2159ce752679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:03 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Volume f89e161f-c977-49fd-b3f1-78526a4d691d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89e161f-c977-49fd-b3f1-78526a4d691d', 'volume_size': 1} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045118167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e161f-c977-49fd-b3f1-78526a4d691d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:04Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Creating volume f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:03 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:03 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d 1073741824 Sep 03 13:52:03 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e" returned: 0 in 0.589s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:04 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f" returned: 0 in 0.569s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:04 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e Sep 03 13:52:04 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef Sep 03 13:52:04 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d 1073741824" returned: 0 in 0.590s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-0469c942-bece-4b73-92f9-2f7b8e8e755e" returned: 0 in 0.300s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-0469c942-bece-4b73-92f9-2f7b8e8e755e" released by "delete_volume" :: held 0.949s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:04 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d Sep 03 13:52:04 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['ef238ec5-ccf2-4a51-b6a6-06354c3d448c', '86b89412-46e1-45dd-8d11-847fec1e7a27', 'c2b562f3-2d5b-4d26-8f57-99b346a3d8a1', 'c9beb3ea-f434-47fd-a3d0-a0d4ebd2da49'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:04 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:04 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef" returned: 0 in 0.503s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:04 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef Sep 03 13:52:04 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:04 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d" returned: 0 in 0.306s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870e93f8-6652-4c50-8111-2159ce752679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89e161f-c977-49fd-b3f1-78526a4d691d', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16d63e-82ad-42c7-b6eb-d93b602c36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:04 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Volume volume-f89e161f-c977-49fd-b3f1-78526a4d691d (f89e161f-c977-49fd-b3f1-78526a4d691d): created successfully Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16d63e-82ad-42c7-b6eb-d93b602c36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:04 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (a4c16182-5039-450d-a736-cd45898ce549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:04 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cd1d8298-7554-493b-9f4c-1843556aad55 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:52:05 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.277s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-72a8ada9-6d45-476a-8539-2f1d28de4b16 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-0469c942-bece-4b73-92f9-2f7b8e8e755e-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:05 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f.f2bbd586-954c-49ec-9851-98bc6dcec0ef" returned: 0 in 0.280s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-f2bbd586-954c-49ec-9851-98bc6dcec0ef" released by "_delete_snapshot" :: held 2.004s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" released by "delete_snapshot" :: held 2.033s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Created reservations ['c9a6c52d-db22-43c2-836b-cde071465cad', '90c45e4b-2cf9-472f-917b-8211635b82df', 'aa7f1454-c59c-4cc3-b248-5b7abe1a1ef8', 'a60deb3a-1738-4901-a2ed-7b7f74d226ac'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Delete snapshot completed successfully. Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e09d753a-c360-48ad-b62f-6c695362c54c tempest-ProjectReaderTests-727263789 None] Lock "cinder-f2bbd586-954c-49ec-9851-98bc6dcec0ef-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-e65c58b7-11f3-4a9a-8b97-d2b217a42638-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-e65c58b7-11f3-4a9a-8b97-d2b217a42638-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "cinder-quobyte-e65c58b7-11f3-4a9a-8b97-d2b217a42638" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-e65c58b7-11f3-4a9a-8b97-d2b217a42638" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8a24d-3e54-4b6a-9e7b-41c24c664c67]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:06 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 Sep 03 13:52:06 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 967cecd3-abbc-4ffd-aa00-0b961602d8a4 of volume f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac0972f-1235-4bd9-a486-2264093f4953]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:06 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d Sep 03 13:52:06 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-01128696-b2d2-4389-a77c-69dc6ec2ea7f-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "cinder-01128696-b2d2-4389-a77c-69dc6ec2ea7f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:06 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:06 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638 Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:06 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b583e84b-dee8-4973-966e-8bf65940ed6f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:06 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d" returned: 0 in 0.468s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:06 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f Sep 03 13:52:06 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:06 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 1G Sep 03 13:52:06 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:06 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-e65c58b7-11f3-4a9a-8b97-d2b217a42638" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-quobyte-e65c58b7-11f3-4a9a-8b97-d2b217a42638" released by "delete_volume" :: held 0.831s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Created reservations ['bf3b8b0d-5671-4837-825a-b25283b4a6f9', '156dfe76-651b-4f02-8814-b860ae9e36d6', 'e0e29ede-5b36-495a-964a-fc7b778a3699', '951391ef-9006-4061-9840-13441d1f00e6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:07 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:07 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:07 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f" returned: 0 in 0.538s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:07 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f Sep 03 13:52:07 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:07 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 1G" returned: 0 in 0.638s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89e161f-c977-49fd-b3f1-78526a4d691d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:07 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89e161f-c977-49fd-b3f1-78526a4d691d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 Sep 03 13:52:07 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:07 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.393s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Deleted volume successfully. Sep 03 13:52:07 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-01128696-b2d2-4389-a77c-69dc6ec2ea7f" returned: 0 in 0.346s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-01128696-b2d2-4389-a77c-69dc6ec2ea7f" released by "delete_volume" :: held 0.978s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d6518678-5eeb-4603-b108-0fe884597e86 tempest-CreateVolumesFromSourceVolumeTest-1588271575 None] Lock "cinder-e65c58b7-11f3-4a9a-8b97-d2b217a42638-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Created reservations ['1944df69-ae02-4239-ad33-58425da62ee9', '71f7a0cc-421a-4404-9572-4ff274035d79', 'b8c5441a-47dc-484b-bbba-0df6456e3157', '0b8757f9-6c55-448a-bd95-a830375ec407'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:07 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:07 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:07 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89e161f-c977-49fd-b3f1-78526a4d691d -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4" returned: 0 in 0.426s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 is being set with open permissions: ugo+rw Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:07 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 Sep 03 13:52:07 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:07 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.341s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:07 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Deleted volume successfully. Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f2e7f5a3-737e-41dc-b051-adcab44d845b tempest-ProjectReaderTests-727263789 None] Lock "cinder-01128696-b2d2-4389-a77c-69dc6ec2ea7f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:08 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4" returned: 0 in 0.392s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:08 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info Sep 03 13:52:08 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:08 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:08 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info is being set with open permissions: ugo+rw Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:08 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info Sep 03 13:52:08 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:08 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.info" returned: 0 in 0.365s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:08 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-57b348a8-13d9-46e7-9e25-5763f174564f tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (853b4d96-0676-46a1-9e86-954432e40167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d59695-632e-42ec-9c59-39b6b55aec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d59695-632e-42ec-9c59-39b6b55aec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261308578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbbd85a-a917-4b0b-86ea-1dd5e2309ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:09Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5665d3a2-5c39-4924-875d-9fc72affbd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5665d3a2-5c39-4924-875d-9fc72affbd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d94920d-c99c-42f8-b068-ac91003f90dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d94920d-c99c-42f8-b068-ac91003f90dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbbd85a-a917-4b0b-86ea-1dd5e2309ece', 'volume_name': 'volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b2155-226f-4cc5-a9ac-9b3286988d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b2155-226f-4cc5-a9ac-9b3286988d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fc1f02-cfdf-409d-8081-fbd190cd12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Volume dbbbd85a-a917-4b0b-86ea-1dd5e2309ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece', 'volume_size': 1} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261308578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbbd85a-a917-4b0b-86ea-1dd5e2309ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:09Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Creating volume dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:09 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-967cecd3-abbc-4ffd-aa00-0b961602d8a4-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:09 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece 1073741824 Sep 03 13:52:09 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-967cecd3-abbc-4ffd-aa00-0b961602d8a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-967cecd3-abbc-4ffd-aa00-0b961602d8a4" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-967cecd3-abbc-4ffd-aa00-0b961602d8a4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 967cecd3-abbc-4ffd-aa00-0b961602d8a4 of volume f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddc5d2f-fea5-4774-a0b8-189901574a1e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:09 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 Sep 03 13:52:09 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:09 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece 1073741824" returned: 0 in 0.566s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:10 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4" returned: 0 in 0.489s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89e161f-c977-49fd-b3f1-78526a4d691d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:10 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece Sep 03 13:52:10 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6e83a-f89b-4dd2-93f4-70a7a52bb344]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:10 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d Sep 03 13:52:10 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:10 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fc1f02-cfdf-409d-8081-fbd190cd12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390cb300-25fa-4a17-b84a-8244bf5cb715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:10 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Volume volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece (dbbbd85a-a917-4b0b-86ea-1dd5e2309ece): created successfully Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390cb300-25fa-4a17-b84a-8244bf5cb715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (853b4d96-0676-46a1-9e86-954432e40167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:10 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4585357f-b4c0-4ebe-99af-e395e12adc47 tempest-ProjectReaderTests-727263789 None] Created volume successfully. Sep 03 13:52:10 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d" returned: 0 in 0.450s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:10 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 Sep 03 13:52:10 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:10 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:10 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:10 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4 Sep 03 13:52:10 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Flow 'volume_create_manager' (5ef4cd63-6ffc-49a1-9e68-f74abc4b7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b873d8-dbff-44f9-8ace-1ccff9637a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e48d769c-1b5b-4fc4-b792-0d015b28040f tempest-ProjectAdminTests-1895178657 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8440437316895, 'free_capacity_gb': 1773.8440437316895, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86933) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b873d8-dbff-44f9-8ace-1ccff9637a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942424673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562f02934647f28d397fc94eef6dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:11Z,use_quota=True,user_id='5c0e984bfc194be2bc25ff3b92ff3fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8081cee-fc0e-405e-be04-c099135f37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8081cee-fc0e-405e-be04-c099135f37cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cf8b99-a131-4a0a-9ce8-b1894a1ed254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cf8b99-a131-4a0a-9ce8-b1894a1ed254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09', 'volume_name': 'volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eccbdd3-67d5-42e5-98c6-d164f755f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eccbdd3-67d5-42e5-98c6-d164f755f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c79b069-7d4e-4fc5-88fd-d2540d6919b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:11 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Volume ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09', 'volume_size': 1} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942424673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562f02934647f28d397fc94eef6dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:11Z,use_quota=True,user_id='5c0e984bfc194be2bc25ff3b92ff3fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Creating volume ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:11 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:11 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 1073741824 Sep 03 13:52:11 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:11 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d.967cecd3-abbc-4ffd-aa00-0b961602d8a4" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-967cecd3-abbc-4ffd-aa00-0b961602d8a4" released by "_delete_snapshot" :: held 1.777s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" released by "delete_snapshot" :: held 1.821s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Created reservations ['cd1808a9-453b-4ba4-bbde-d7346564d10a', '651871cc-9e1c-46ad-8927-afa89b940684', '94c2362a-5666-445d-ab97-9130916b38c5', '94622bd7-88bc-4f1c-908a-b8e0c7553a1a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-e51cd342-c490-4ac6-aad4-8ab1835dfad6 tempest-ProjectMemberTests-669573642 None] Lock "cinder-967cecd3-abbc-4ffd-aa00-0b961602d8a4-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-f89e161f-c977-49fd-b3f1-78526a4d691d-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "cinder-f89e161f-c977-49fd-b3f1-78526a4d691d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:11 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 1073741824" returned: 0 in 0.593s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" acquired by "delete_volume" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef488a-81de-4e2a-b438-96f027b29dc7]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:11 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 Sep 03 13:52:11 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:11 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d Sep 03 13:52:11 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:12 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" returned: 0 in 0.291s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.390s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c79b069-7d4e-4fc5-88fd-d2540d6919b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8651449-fb53-4f92-980d-ee98d40101c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Creating offline snapshot 4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f of volume dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:12 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Volume volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 (ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09): created successfully Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8651449-fb53-4f92-980d-ee98d40101c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Flow 'volume_create_manager' (5ef4cd63-6ffc-49a1-9e68-f74abc4b7e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0439bc-d943-48fc-be07-ac9d0f0b17a9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:12 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d96fe580-9cf3-45c1-bf75-8855bdd16446 tempest-ProjectReaderTests-1059035353 None] Created volume successfully. Sep 03 13:52:12 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:12 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d Sep 03 13:52:12 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:12 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece Sep 03 13:52:12 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:12 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-f89e161f-c977-49fd-b3f1-78526a4d691d" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-f89e161f-c977-49fd-b3f1-78526a4d691d" released by "delete_volume" :: held 0.776s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:12 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:12 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f 1G Sep 03 13:52:12 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Created reservations ['2034ada0-a6c1-4233-b20c-0efaf7608759', '2c60245a-4dce-413d-a7f7-46dcbbeedd6b', 'ec5e5d3f-71b7-46fe-90a6-b6944dff5851', '87fb60c5-3805-44b9-b332-6d10fb800232'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:12 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:12 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:12 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.332s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:13 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-4d14659b-eca2-404c-ab79-a0830d165c41 tempest-ProjectMemberTests-669573642 None] Lock "cinder-f89e161f-c977-49fd-b3f1-78526a4d691d-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:13 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f 1G" returned: 0 in 0.596s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:13 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f Sep 03 13:52:13 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (c324bde1-4f99-41a4-9c63-940b7f04caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70eba8b1-0929-4303-b12d-0d2fce06d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Acquiring lock "cinder-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70eba8b1-0929-4303-b12d-0d2fce06d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131649022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a19275-fd8f-45a6-8470-bc363c926d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:13Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2141d08-31e5-4d3d-9455-bd93324acb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2141d08-31e5-4d3d-9455-bd93324acb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4581cd48-4eeb-40e2-a157-2c876a4fc7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4581cd48-4eeb-40e2-a157-2c876a4fc7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a19275-fd8f-45a6-8470-bc363c926d97', 'volume_name': 'volume-c0a19275-fd8f-45a6-8470-bc363c926d97', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4bd0a3-55d4-44cd-8e57-fa80400f0bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4bd0a3-55d4-44cd-8e57-fa80400f0bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93acfc33-9880-4af6-9772-8b90587b4806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:13 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Volume c0a19275-fd8f-45a6-8470-bc363c926d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a19275-fd8f-45a6-8470-bc363c926d97', 'volume_size': 1} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "cinder-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Acquiring lock "cinder-quobyte-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:13 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" returned: 0 in 0.419s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:13 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f is being set with open permissions: ugo+rw Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "cinder-quobyte-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" acquired by "delete_volume" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:13 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f Sep 03 13:52:13 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2e9fe-59b5-42a5-82e6-bc4743cf577d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:13 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 Sep 03 13:52:13 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:13 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" returned: 0 in 0.267s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:13 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info Sep 03 13:52:13 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:14 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" returned: 0 in 0.421s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:14 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09 Sep 03 13:52:14 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:14 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info" returned: 0 in 0.277s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:14 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info is being set with open permissions: ugo+rw Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:14 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info Sep 03 13:52:14 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:14 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "cinder-quobyte-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09" released by "delete_volume" :: held 0.759s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Created reservations ['9bc0da53-337a-45ff-a54b-c154817b7592', 'e4326358-a28b-4837-8665-72ec039edebf', '4bada9fb-3f65-42a4-b5e3-64cd1496df88', '0378d7bc-72d0-49e0-a8b6-76dca91c27dc'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:14 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.info" returned: 0 in 0.284s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131649022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a19275-fd8f-45a6-8470-bc363c926d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:13Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Creating volume c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:14 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:14 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 1073741824 Sep 03 13:52:14 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b02cadd1-b0cf-48ab-ba5e-72a259600624 tempest-ProjectReaderTests-727263789 None] Create snapshot completed successfully Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:14 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:14 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:14 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.404s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Deleted volume successfully. Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-640de98e-22b8-4970-ab71-9705c6d69924 tempest-ProjectReaderTests-1059035353 None] Lock "cinder-ae31fe9b-01c4-45b9-a36d-c0a0a78f3d09-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Deleting offline snapshot 4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f of volume dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] snapshot_file for this snap is: volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e697e6-ddd0-4a89-856b-5eb792f8a668]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:15 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 1073741824" returned: 0 in 0.670s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:15 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f Sep 03 13:52:15 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:15 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 Sep 03 13:52:15 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Flow 'volume_create_manager' (5c244fc3-4c8b-4790-b124-38b1a8c19275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fb913b-4eb6-46a9-9bba-be4c678b1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fb913b-4eb6-46a9-9bba-be4c678b1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920413629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f6ce50-58a3-4738-9025-cddc2591fa6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562f02934647f28d397fc94eef6dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:15Z,use_quota=True,user_id='5c0e984bfc194be2bc25ff3b92ff3fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927c0106-42fa-44ee-80ac-3e83705fd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927c0106-42fa-44ee-80ac-3e83705fd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bf5a43-fbe4-4f5f-bb12-0d026287301b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bf5a43-fbe4-4f5f-bb12-0d026287301b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f6ce50-58a3-4738-9025-cddc2591fa6e', 'volume_name': 'volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee7c518-af38-44ce-8f7b-c5a30f7c9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee7c518-af38-44ce-8f7b-c5a30f7c9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590cc152-a66d-467f-9b2a-b0791cb2b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Volume b0f6ce50-58a3-4738-9025-cddc2591fa6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e', 'volume_size': 1} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:15 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97" returned: 0 in 0.366s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920413629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f6ce50-58a3-4738-9025-cddc2591fa6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562f02934647f28d397fc94eef6dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:15Z,use_quota=True,user_id='5c0e984bfc194be2bc25ff3b92ff3fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Creating volume b0f6ce50-58a3-4738-9025-cddc2591fa6e {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:15 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:15 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" returned: 0 in 0.536s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:15 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e 1073741824 Sep 03 13:52:15 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93acfc33-9880-4af6-9772-8b90587b4806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a19275-fd8f-45a6-8470-bc363c926d97', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d6ae0-95bf-46cf-a60e-ff33c593d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c3ec1-33d3-4445-9fa2-8f83122c995d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:15 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Volume volume-c0a19275-fd8f-45a6-8470-bc363c926d97 (c0a19275-fd8f-45a6-8470-bc363c926d97): created successfully Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d6ae0-95bf-46cf-a60e-ff33c593d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:15 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (c324bde1-4f99-41a4-9c63-940b7f04caa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-479beba5-4cce-45e1-a262-036bc17405d7 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:52:15 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece Sep 03 13:52:15 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:16 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" returned: 0 in 0.487s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:16 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e 1073741824" returned: 0 in 0.596s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:16 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f Sep 03 13:52:16 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:16 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e Sep 03 13:52:16 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:16 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e" returned: 0 in 0.264s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590cc152-a66d-467f-9b2a-b0791cb2b76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947f3f2b-6193-4d41-9613-83c0a4a7512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:16 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Volume volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e (b0f6ce50-58a3-4738-9025-cddc2591fa6e): created successfully Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947f3f2b-6193-4d41-9613-83c0a4a7512f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:16 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Flow 'volume_create_manager' (5c244fc3-4c8b-4790-b124-38b1a8c19275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:16 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-675666a6-1083-4d08-ab36-c6ed0e6694cb tempest-ProjectReaderTests-1059035353 None] Created volume successfully. Sep 03 13:52:16 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f Sep 03 13:52:16 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 657128f7-006d-4494-b666-b4fabc8f66c9 of volume c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f8c35-3b96-4280-98af-e43372dd716d]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:16 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece.4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f" released by "_delete_snapshot" :: held 1.880s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" released by "delete_snapshot" :: held 1.925s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:16 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Created reservations ['1330b34c-d9de-42b5-8283-cdc8c74ffbe8', 'bf4aa8be-048e-4a11-bf47-9f51a67d2727', '32b8212c-a60c-486b-99c1-e3b4b88beba3', '905b3bc7-ad69-4b46-8171-c417b92144d1'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:16 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 Sep 03 13:52:16 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:17 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Delete snapshot completed successfully. Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-13463663-401b-413e-bdff-a01e278456e0 tempest-ProjectReaderTests-727263789 None] Lock "cinder-4a11ed2f-ea4d-4010-8c0e-1fef2ba0711f-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:17 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97" returned: 0 in 0.445s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:17 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 1G Sep 03 13:52:17 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Acquiring lock "cinder-b0f6ce50-58a3-4738-9025-cddc2591fa6e-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "cinder-b0f6ce50-58a3-4738-9025-cddc2591fa6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Acquiring lock "cinder-quobyte-b0f6ce50-58a3-4738-9025-cddc2591fa6e" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "cinder-quobyte-b0f6ce50-58a3-4738-9025-cddc2591fa6e" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b3895a-9fb8-4a13-953e-9de3e830ac38]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:17 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e Sep 03 13:52:17 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:17 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 1G" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:17 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a19275-fd8f-45a6-8470-bc363c926d97 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:17 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a19275-fd8f-45a6-8470-bc363c926d97 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 Sep 03 13:52:17 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a19275-fd8f-45a6-8470-bc363c926d97 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9" returned: 0 in 0.335s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 is being set with open permissions: ugo+rw Sep 03 13:52:18 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 Sep 03 13:52:18 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "cinder-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5cf70e-e4eb-4330-af68-cbd4538f754b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b0f6ce50-58a3-4738-9025-cddc2591fa6e" returned: 0 in 0.319s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "cinder-quobyte-b0f6ce50-58a3-4738-9025-cddc2591fa6e" released by "delete_volume" :: held 0.818s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Created reservations ['47cadd8e-d224-405f-a70c-3504a0adfeaf', '71f5774a-7d10-4222-bde2-b7c0771ba27a', '10ce464e-d628-456b-bf2b-de818d1a8287', 'df2dec5f-ca5e-4df3-af7a-f5564a71d719'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:18 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9" returned: 0 in 0.404s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece Sep 03 13:52:18 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:18 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info Sep 03 13:52:18 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:18 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info" returned: 0 in 0.358s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info is being set with open permissions: ugo+rw Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info Sep 03 13:52:18 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:18 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.375s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:18 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Deleted volume successfully. Sep 03 13:52:18 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" returned: 0 in 0.654s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:18 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-8629f352-bc5c-4f1b-b4bd-889b0cec8ebc tempest-ProjectReaderTests-1059035353 None] Lock "cinder-b0f6ce50-58a3-4738-9025-cddc2591fa6e-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:18 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece Sep 03 13:52:18 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:19 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.info" returned: 0 in 0.316s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c2862487-faa2-4b61-a659-f6e3df70f0c9 tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:52:19 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece" released by "delete_volume" :: held 1.023s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Created reservations ['c7fce7f0-1d1f-4211-8f91-400b2cf9ecd9', '5b6596c9-f117-4bfb-a886-664be8b715a3', '5f7325f4-ccf0-431b-854e-0438ea7db025', '9dab7118-beb9-46f2-8376-e6b37a95f108'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:19 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:19 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:19 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.323s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:19 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Deleted volume successfully. Sep 03 13:52:19 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-d7d925e5-0484-450f-ad9d-614fc0ce176f tempest-ProjectReaderTests-727263789 None] Lock "cinder-dbbbd85a-a917-4b0b-86ea-1dd5e2309ece-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-657128f7-006d-4494-b666-b4fabc8f66c9-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-657128f7-006d-4494-b666-b4fabc8f66c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-657128f7-006d-4494-b666-b4fabc8f66c9" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-657128f7-006d-4494-b666-b4fabc8f66c9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 657128f7-006d-4494-b666-b4fabc8f66c9 of volume c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e963fa0d-36ff-47a0-9ee0-aa450516c485]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:20 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 Sep 03 13:52:20 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:20 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9" returned: 0 in 0.529s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a19275-fd8f-45a6-8470-bc363c926d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fa0be-6d17-4524-ada9-55d872587f83]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:20 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:20 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 Sep 03 13:52:20 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (97a9a5ff-34bd-4175-ba3e-c674c35e4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c67b2-1560-4c5d-9780-7a8b3ec7ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c67b2-1560-4c5d-9780-7a8b3ec7ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10733027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536eb699-ecba-4366-bc9c-ba83ff8b5158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:21Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2250a7-7330-484d-8a23-76eb5ac8093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2250a7-7330-484d-8a23-76eb5ac8093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839540c-b006-42dd-8682-e380295a8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839540c-b006-42dd-8682-e380295a8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536eb699-ecba-4366-bc9c-ba83ff8b5158', 'volume_name': 'volume-536eb699-ecba-4366-bc9c-ba83ff8b5158', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a270ae-94bf-4b46-9366-455a9d55284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a270ae-94bf-4b46-9366-455a9d55284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e3e1d-2ff4-4612-a02e-8febd80ec6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:21 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Volume 536eb699-ecba-4366-bc9c-ba83ff8b5158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536eb699-ecba-4366-bc9c-ba83ff8b5158', 'volume_size': 1} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10733027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536eb699-ecba-4366-bc9c-ba83ff8b5158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:21Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Creating volume 536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:21 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:21 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 1073741824 Sep 03 13:52:21 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:21 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97" returned: 0 in 0.558s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:21 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 Sep 03 13:52:21 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:21 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 1073741824" returned: 0 in 0.514s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:21 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9" returned: 0 in 0.478s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:21 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9 Sep 03 13:52:21 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:21 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:21 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 Sep 03 13:52:21 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:22 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97.657128f7-006d-4494-b666-b4fabc8f66c9" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-657128f7-006d-4494-b666-b4fabc8f66c9" released by "_delete_snapshot" :: held 2.063s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" released by "delete_snapshot" :: held 2.107s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:22 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158" returned: 0 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e3e1d-2ff4-4612-a02e-8febd80ec6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536eb699-ecba-4366-bc9c-ba83ff8b5158', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c60a6-6ae9-4f00-81ae-2ff7ee6812df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:22 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Volume volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 (536eb699-ecba-4366-bc9c-ba83ff8b5158): created successfully Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c60a6-6ae9-4f00-81ae-2ff7ee6812df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (97a9a5ff-34bd-4175-ba3e-c674c35e4e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-4e243eba-b5f2-4e90-a330-9bd71365c077 tempest-ProjectReaderTests-727263789 None] Created volume successfully. Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Created reservations ['3b307cb2-9e5f-4997-bf17-838e1d07a23f', '49c51569-3fbc-4656-b74f-32bfdc8ad202', '692fab5b-f5a8-4fde-a1e2-871960152c99', 'a2bf0cdb-17a6-4c71-a383-e258e27adc75'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:22 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:22 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f87a9d3b-d2ec-4e1e-96fa-979e2149f216 tempest-ProjectMemberTests-669573642 None] Lock "cinder-657128f7-006d-4494-b666-b4fabc8f66c9-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-c0a19275-fd8f-45a6-8470-bc363c926d97-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "cinder-c0a19275-fd8f-45a6-8470-bc363c926d97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" acquired by "delete_volume" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec563178-c103-402d-8ad8-0acc2303763b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Creating offline snapshot 239b8cbf-caea-472c-8eb4-9f5615047e09 of volume 536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc95af7-5e37-4584-8ab3-39fcfb41786b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:23 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 Sep 03 13:52:23 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:23 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 Sep 03 13:52:23 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:23 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:23 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97 Sep 03 13:52:23 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:24 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158" returned: 0 in 0.430s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:24 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 1G Sep 03 13:52:24 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:24 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c0a19275-fd8f-45a6-8470-bc363c926d97" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c0a19275-fd8f-45a6-8470-bc363c926d97" released by "delete_volume" :: held 0.762s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Created reservations ['4912bdd1-094c-4e6c-ae9b-541b66639410', '7ece4ec8-5306-4f07-a0d9-1bf422276a4f', '4d267195-c445-460d-af56-72bc10b610f8', '304cccaa-02c6-48e3-a0ee-d2b0db3a3e5f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:24 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:24 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:24 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 1G" returned: 0 in 0.440s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:24 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 Sep 03 13:52:24 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:24 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.305s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-5fddc650-b0f6-414b-922d-38048cef47a0 tempest-ProjectMemberTests-669573642 None] Lock "cinder-c0a19275-fd8f-45a6-8470-bc363c926d97-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:24 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09" returned: 0 in 0.358s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:24 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 is being set with open permissions: ugo+rw Sep 03 13:52:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:24 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 Sep 03 13:52:24 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (082cb95a-6a22-4e05-a6e1-f8c5c87a336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:25 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5216dd-3d1c-4af9-8da3-6d917304aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09" returned: 0 in 0.291s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5216dd-3d1c-4af9-8da3-6d917304aef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365048170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30277e3d-a324-444d-b34a-623ff8f0a469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:25Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c74a21-edba-4a1d-b587-0c06c3febf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c74a21-edba-4a1d-b587-0c06c3febf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfaac32-1c7f-4b70-a27d-83f7128b12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfaac32-1c7f-4b70-a27d-83f7128b12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30277e3d-a324-444d-b34a-623ff8f0a469', 'volume_name': 'volume-30277e3d-a324-444d-b34a-623ff8f0a469', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e00adc2-2888-46ea-8c56-08e5263abe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e00adc2-2888-46ea-8c56-08e5263abe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d8c752-cfbd-41b5-818a-559a9c636fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:25 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Volume 30277e3d-a324-444d-b34a-623ff8f0a469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30277e3d-a324-444d-b34a-623ff8f0a469', 'volume_size': 1} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:25 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info Sep 03 13:52:25 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:25 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info" returned: 0 in 0.291s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:25 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info is being set with open permissions: ugo+rw Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:25 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info Sep 03 13:52:25 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:25 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.info" returned: 0 in 0.291s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365048170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30277e3d-a324-444d-b34a-623ff8f0a469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:25Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Creating volume 30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:25 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:25 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 1073741824 Sep 03 13:52:25 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-721543cf-466b-40a4-896a-419ef0a02383 tempest-ProjectReaderTests-727263789 None] Create snapshot completed successfully Sep 03 13:52:26 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 1073741824" returned: 0 in 0.455s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:26 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 Sep 03 13:52:26 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:26 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d8c752-cfbd-41b5-818a-559a9c636fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30277e3d-a324-444d-b34a-623ff8f0a469', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fb1e72-c1d4-4b05-9e1d-2f4648483d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Volume volume-30277e3d-a324-444d-b34a-623ff8f0a469 (30277e3d-a324-444d-b34a-623ff8f0a469): created successfully Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fb1e72-c1d4-4b05-9e1d-2f4648483d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (082cb95a-6a22-4e05-a6e1-f8c5c87a336d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:26 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b980bac4-473a-4ef9-9394-4f5a4620b9ba tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-239b8cbf-caea-472c-8eb4-9f5615047e09-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-239b8cbf-caea-472c-8eb4-9f5615047e09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-239b8cbf-caea-472c-8eb4-9f5615047e09" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-239b8cbf-caea-472c-8eb4-9f5615047e09" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Deleting offline snapshot 239b8cbf-caea-472c-8eb4-9f5615047e09 of volume 536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] snapshot_file for this snap is: volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f85882-47f2-465b-b216-1d6cd9b1a0d9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:27 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 Sep 03 13:52:27 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:27 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536eb699-ecba-4366-bc9c-ba83ff8b5158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4220d809-dd86-414f-ac96-05723798d76e]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 48eda113-b511-4d08-a9d6-98843d2d0e02 of volume 30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cec2a9-8dba-49c8-a0f6-48b5ef583f94]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:27 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 Sep 03 13:52:27 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:27 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 Sep 03 13:52:27 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:27 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158" returned: 0 in 0.444s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:27 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469" returned: 0 in 0.404s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:27 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 Sep 03 13:52:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:27 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:27 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 1G Sep 03 13:52:27 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:28 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09" returned: 0 in 0.422s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:28 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09 Sep 03 13:52:28 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:28 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 1G" returned: 0 in 0.490s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30277e3d-a324-444d-b34a-623ff8f0a469 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:28 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30277e3d-a324-444d-b34a-623ff8f0a469 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 Sep 03 13:52:28 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:28 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158.239b8cbf-caea-472c-8eb4-9f5615047e09" returned: 0 in 0.273s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-239b8cbf-caea-472c-8eb4-9f5615047e09" released by "_delete_snapshot" :: held 1.705s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" released by "delete_snapshot" :: held 1.732s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Created reservations ['fa82fc90-4f70-42cf-8d87-9092aa02bad6', '93596633-3e69-413d-898f-0911b25a5dc4', '468e72b5-316a-4cb2-a414-a3dbd83f7ed1', 'd3bce340-be66-40bc-8526-d68925ac03d6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:28 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30277e3d-a324-444d-b34a-623ff8f0a469 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02" returned: 0 in 0.341s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:28 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 is being set with open permissions: ugo+rw Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Delete snapshot completed successfully. Sep 03 13:52:28 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 Sep 03 13:52:28 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-cd24689c-9c2d-45af-8b57-99f9031674d6 tempest-ProjectReaderTests-727263789 None] Lock "cinder-239b8cbf-caea-472c-8eb4-9f5615047e09-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:28 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-536eb699-ecba-4366-bc9c-ba83ff8b5158-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "cinder-536eb699-ecba-4366-bc9c-ba83ff8b5158-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:29 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info Sep 03 13:52:29 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" acquired by "delete_volume" :: waited 0.040s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d9bdda-38f2-4842-b5ac-4aaa7a83e1c1]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:29 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 Sep 03 13:52:29 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:29 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info" returned: 0 in 0.304s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:29 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info is being set with open permissions: ugo+rw Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:29 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info Sep 03 13:52:29 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:29 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:29 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158" returned: 0 in 0.413s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.info" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:29 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158 Sep 03 13:52:29 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-85abb899-0f7d-44a9-86de-bee08a4113aa tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:52:29 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-536eb699-ecba-4366-bc9c-ba83ff8b5158" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-536eb699-ecba-4366-bc9c-ba83ff8b5158" released by "delete_volume" :: held 0.755s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Created reservations ['9acc2167-a2f7-4f0e-8719-c0323e345915', '3037825d-17b0-49ba-874c-0503ff93abe8', '67abb0a3-13ce-44b7-9f4b-ef6067722465', '32aefda6-4e7d-4088-8d19-71a5d338faa2'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:30 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:30 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:30 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.270s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Deleted volume successfully. Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7f85eb85-9686-40bc-a8bd-8ec8662821e8 tempest-ProjectReaderTests-727263789 None] Lock "cinder-536eb699-ecba-4366-bc9c-ba83ff8b5158-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-48eda113-b511-4d08-a9d6-98843d2d0e02-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-48eda113-b511-4d08-a9d6-98843d2d0e02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-48eda113-b511-4d08-a9d6-98843d2d0e02" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-48eda113-b511-4d08-a9d6-98843d2d0e02" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 48eda113-b511-4d08-a9d6-98843d2d0e02 of volume 30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49a951-ea92-45b4-9896-e502d84876ad]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (bf653511-f4db-41ed-a531-1cab8af69f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfc9c0-1d96-4e42-a818-60bf1fd1824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfc9c0-1d96-4e42-a818-60bf1fd1824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172686642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fff01-8b58-4b26-a30a-c4018897b7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:31Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca620cc1-0d1d-4608-b9e4-b68160cdfe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca620cc1-0d1d-4608-b9e4-b68160cdfe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:30 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 Sep 03 13:52:30 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fb58f2-9a2c-4f12-88ec-7a818f03c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fb58f2-9a2c-4f12-88ec-7a818f03c280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407fff01-8b58-4b26-a30a-c4018897b7f8', 'volume_name': 'volume-407fff01-8b58-4b26-a30a-c4018897b7f8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d092a50-a098-43d9-9f7d-d7f9106aa787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d092a50-a098-43d9-9f7d-d7f9106aa787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b4e892-4de5-4eb8-a271-72cf893da51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:30 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Volume 407fff01-8b58-4b26-a30a-c4018897b7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407fff01-8b58-4b26-a30a-c4018897b7f8', 'volume_size': 1} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172686642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fff01-8b58-4b26-a30a-c4018897b7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b977b66d334b6fbf04384ce3dee9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:31Z,use_quota=True,user_id='85839a876f9d4d9890bb5d03198d86c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Creating volume 407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:30 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:30 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 1073741824 Sep 03 13:52:30 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:31 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02" returned: 0 in 0.410s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30277e3d-a324-444d-b34a-623ff8f0a469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6095a17-ece4-4f79-b141-86aa4cc161ad]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:31 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 Sep 03 13:52:31 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:31 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 1073741824" returned: 0 in 0.493s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:31 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 Sep 03 13:52:31 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:31 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469" returned: 0 in 0.546s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:31 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 Sep 03 13:52:31 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:31 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8" returned: 0 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b4e892-4de5-4eb8-a271-72cf893da51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407fff01-8b58-4b26-a30a-c4018897b7f8', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40742ee1-ec4a-4961-b08f-70fda3202bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Volume volume-407fff01-8b58-4b26-a30a-c4018897b7f8 (407fff01-8b58-4b26-a30a-c4018897b7f8): created successfully Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40742ee1-ec4a-4961-b08f-70fda3202bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Flow 'volume_create_manager' (bf653511-f4db-41ed-a531-1cab8af69f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:31 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b1c56961-50f7-4015-bd06-fd964857a281 tempest-ProjectReaderTests-727263789 None] Created volume successfully. Sep 03 13:52:32 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02" returned: 0 in 0.382s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:32 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02 Sep 03 13:52:32 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:32 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469.48eda113-b511-4d08-a9d6-98843d2d0e02" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-48eda113-b511-4d08-a9d6-98843d2d0e02" released by "_delete_snapshot" :: held 1.701s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" released by "delete_snapshot" :: held 1.730s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Created reservations ['c091ecd5-2828-47fa-8243-daf4d0756624', '56f85747-4608-4915-b4ed-49fb7b52094e', '9e695b9e-36e7-4e1b-987a-5ccdaa3a85a0', '0c39e519-2c89-459b-b827-44a3f6ef1338'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-7b91137a-d943-43d6-bd7e-a63281646a8d tempest-ProjectMemberTests-669573642 None] Lock "cinder-48eda113-b511-4d08-a9d6-98843d2d0e02-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-30277e3d-a324-444d-b34a-623ff8f0a469-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "cinder-30277e3d-a324-444d-b34a-623ff8f0a469-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" acquired by "delete_volume" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f835f-e0fa-4480-a324-67d2ece2e31c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 Sep 03 13:52:33 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Creating offline snapshot f00fcf40-afcc-436a-ba77-3494f04fc79b of volume 407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb3539-03e5-4ca9-90ce-b4ae398e0db0]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 Sep 03 13:52:33 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:33 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469" returned: 0 in 0.436s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469 Sep 03 13:52:33 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:33 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8" returned: 0 in 0.422s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b 1G Sep 03 13:52:33 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-30277e3d-a324-444d-b34a-623ff8f0a469" returned: 0 in 0.340s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:33 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:33 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-30277e3d-a324-444d-b34a-623ff8f0a469" released by "delete_volume" :: held 0.888s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Created reservations ['b3af9801-6467-4d05-98df-f7b64f5a2ed2', 'd096299d-0ad5-4777-8475-165a2032d5ed', '21ba2f9b-6f16-468b-8470-835e77135438', '4fef78b5-5e6a-41e8-866f-0250f828a72b'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:33 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:33 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:34 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b 1G" returned: 0 in 0.677s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:34 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407fff01-8b58-4b26-a30a-c4018897b7f8 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.568s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:52:34 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407fff01-8b58-4b26-a30a-c4018897b7f8 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b Sep 03 13:52:34 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:34 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:34 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0528a94d-53b5-42d9-8788-8fe22d2dd796 tempest-ProjectMemberTests-669573642 None] Lock "cinder-30277e3d-a324-444d-b34a-623ff8f0a469-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:34 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407fff01-8b58-4b26-a30a-c4018897b7f8 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b" returned: 0 in 0.437s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:34 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b is being set with open permissions: ugo+rw Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:34 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b Sep 03 13:52:34 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (cd81cc75-043a-4046-bb57-c67f5f0629fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9c1310-6e35-4ee3-b82b-2025e72fa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9c1310-6e35-4ee3-b82b-2025e72fa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046720797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbb1956-dbca-4af3-bfe6-a27777436dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:35Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094239de-d027-45a2-be08-83ed1589b4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094239de-d027-45a2-be08-83ed1589b4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3074ed-7274-4fc7-803d-bf663fcdebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3074ed-7274-4fc7-803d-bf663fcdebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbb1956-dbca-4af3-bfe6-a27777436dea', 'volume_name': 'volume-bdbb1956-dbca-4af3-bfe6-a27777436dea', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42dd70a-bec9-443f-bc2c-c4219431dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42dd70a-bec9-443f-bc2c-c4219431dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fec582-ee6a-4761-9c56-c6322ddda080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:34 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Volume bdbb1956-dbca-4af3-bfe6-a27777436dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbb1956-dbca-4af3-bfe6-a27777436dea', 'volume_size': 1} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:34 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b" returned: 0 in 0.312s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:35 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info Sep 03 13:52:35 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:35 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:35 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info is being set with open permissions: ugo+rw Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:35 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info Sep 03 13:52:35 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:35 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.info" returned: 0 in 0.252s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046720797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbb1956-dbca-4af3-bfe6-a27777436dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:35Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Creating volume bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:35 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:35 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:35 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea 1073741824 Sep 03 13:52:35 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:35 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-54ed1423-95c8-43ee-ab18-6f71b12d6fab tempest-ProjectReaderTests-727263789 None] Create snapshot completed successfully Sep 03 13:52:36 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea 1073741824" returned: 0 in 0.485s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:36 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea Sep 03 13:52:36 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-f00fcf40-afcc-436a-ba77-3494f04fc79b-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-f00fcf40-afcc-436a-ba77-3494f04fc79b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-f00fcf40-afcc-436a-ba77-3494f04fc79b" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-f00fcf40-afcc-436a-ba77-3494f04fc79b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Deleting offline snapshot f00fcf40-afcc-436a-ba77-3494f04fc79b of volume 407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:36 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] snapshot_file for this snap is: volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea" returned: 0 in 0.345s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fec582-ee6a-4761-9c56-c6322ddda080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbb1956-dbca-4af3-bfe6-a27777436dea', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c13628-629e-40b8-83fe-f5ea9ab8344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3ac64-a575-4d70-aa03-70262e3e634f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:36 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Volume volume-bdbb1956-dbca-4af3-bfe6-a27777436dea (bdbb1956-dbca-4af3-bfe6-a27777436dea): created successfully Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c13628-629e-40b8-83fe-f5ea9ab8344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (cd81cc75-043a-4046-bb57-c67f5f0629fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:36 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-467c71c8-407d-468a-bda9-5f2d690fac74 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:52:36 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b Sep 03 13:52:36 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:36 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b" returned: 0 in 0.480s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407fff01-8b58-4b26-a30a-c4018897b7f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a866b0f1-272c-48ac-954b-80d3a788064a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:36 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 03a558c9-0bd5-456c-b7db-8562b4594966 of volume bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:37 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 Sep 03 13:52:37 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a444da6-7497-43c8-a4f6-e0bc4ad60b31]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:37 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea Sep 03 13:52:37 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:37 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8" returned: 0 in 0.476s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:37 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b Sep 03 13:52:37 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:37 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea" returned: 0 in 0.446s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:37 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 1G Sep 03 13:52:37 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:37 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b" returned: 0 in 0.401s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:37 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b Sep 03 13:52:37 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:38 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 1G" returned: 0 in 0.477s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbb1956-dbca-4af3-bfe6-a27777436dea -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbb1956-dbca-4af3-bfe6-a27777436dea -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 Sep 03 13:52:38 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:38 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8.f00fcf40-afcc-436a-ba77-3494f04fc79b" returned: 0 in 0.296s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-f00fcf40-afcc-436a-ba77-3494f04fc79b" released by "_delete_snapshot" :: held 1.805s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" released by "delete_snapshot" :: held 1.833s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Created reservations ['65c09c50-eb17-48da-aedc-629d3a890a3f', 'dcd6b834-f317-4ad5-b5c9-50137a3645b5', '820c5783-91fe-47cb-826a-273b65d038b3', 'cc609f07-4858-4005-9c78-3955495a4f33'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Flow 'volume_create_manager' (68045564-49f4-4a0c-920f-109e02a071a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fae2d3-27eb-4181-aaa3-cd38da102058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fae2d3-27eb-4181-aaa3-cd38da102058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259131942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194605d8-e2b6-4870-9cf0-39dcba37f8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f5e86a23f34671b518e544193c6b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:38Z,use_quota=True,user_id='e5725c1cee6140e9856e9de9523582a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a40a21-6832-4de6-a450-0dbc5f05dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a40a21-6832-4de6-a450-0dbc5f05dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af250246-4a14-4cd1-a7dd-1bf038d6c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af250246-4a14-4cd1-a7dd-1bf038d6c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194605d8-e2b6-4870-9cf0-39dcba37f8bd', 'volume_name': 'volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec01b7c-ab2c-49ea-88b1-105c131d7f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec01b7c-ab2c-49ea-88b1-105c131d7f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd5c77-3a20-4264-a376-51b68a46bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:38 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Volume 194605d8-e2b6-4870-9cf0-39dcba37f8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd', 'volume_size': 1} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:38 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Delete snapshot completed successfully. Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-0861294e-135f-412b-aee9-dea566dd18c4 tempest-ProjectReaderTests-727263789 None] Lock "cinder-f00fcf40-afcc-436a-ba77-3494f04fc79b-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:38 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbb1956-dbca-4af3-bfe6-a27777436dea -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966" returned: 0 in 0.342s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 is being set with open permissions: ugo+rw Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 Sep 03 13:52:38 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-407fff01-8b58-4b26-a30a-c4018897b7f8-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "cinder-407fff01-8b58-4b26-a30a-c4018897b7f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Acquiring lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" acquired by "delete_volume" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffbd07f-4bfb-40b0-96b4-ddd4e54320b4]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 Sep 03 13:52:38 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info Sep 03 13:52:38 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:38 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8" returned: 0 in 0.376s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:38 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info is being set with open permissions: ugo+rw Sep 03 13:52:38 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:38 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8 Sep 03 13:52:39 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:39 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info Sep 03 13:52:39 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:39 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:39 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-407fff01-8b58-4b26-a30a-c4018897b7f8" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.info" returned: 0 in 0.262s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "cinder-quobyte-407fff01-8b58-4b26-a30a-c4018897b7f8" released by "delete_volume" :: held 0.719s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259131942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194605d8-e2b6-4870-9cf0-39dcba37f8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f5e86a23f34671b518e544193c6b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:38Z,use_quota=True,user_id='e5725c1cee6140e9856e9de9523582a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Creating volume 194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:39 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:39 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd 1073741824 Sep 03 13:52:39 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-68397f37-c4ec-4780-b0b6-1a4b8ef42da4 tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Created reservations ['f679ad5e-6e1d-417e-a02a-af16113a3c42', '14d70617-38a8-4ee8-acb2-f45d921147a5', '5a8e733d-60b1-4a18-9581-f553c80ec533', '5d153cf6-0168-423f-b3d7-bdda53cafd00'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:39 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:39 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:39 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.276s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:39 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Deleted volume successfully. Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-1d1a7efa-197d-48ac-a935-9644d7f2a11a tempest-ProjectReaderTests-727263789 None] Lock "cinder-407fff01-8b58-4b26-a30a-c4018897b7f8-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:39 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd 1073741824" returned: 0 in 0.473s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:39 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:39 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:39 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:40 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd5c77-3a20-4264-a376-51b68a46bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4db4c3-ec3d-4f36-84ea-2a0027d23f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:40 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Volume volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd (194605d8-e2b6-4870-9cf0-39dcba37f8bd): created successfully Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4db4c3-ec3d-4f36-84ea-2a0027d23f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Flow 'volume_create_manager' (68045564-49f4-4a0c-920f-109e02a071a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:40 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-c8d81e49-7e73-441f-9306-ef67bfcecc3e tempest-SnapshotDependencyTests-583116048 None] Created volume successfully. Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-03a558c9-0bd5-456c-b7db-8562b4594966-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-03a558c9-0bd5-456c-b7db-8562b4594966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-03a558c9-0bd5-456c-b7db-8562b4594966" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-03a558c9-0bd5-456c-b7db-8562b4594966" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 03a558c9-0bd5-456c-b7db-8562b4594966 of volume bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b5ae7-80a9-45db-9e7c-4c00b8bef516]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:40 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 Sep 03 13:52:40 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Creating offline snapshot 98337e75-73ba-4c82-895b-7b0fbb39921e of volume 194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa4dcc-218b-4910-a5ba-d9acadeecfe3]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:40 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:40 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:40 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966" returned: 0 in 0.478s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbb1956-dbca-4af3-bfe6-a27777436dea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3951d51f-01f5-494b-a714-6cd339cdcf18]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:40 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea Sep 03 13:52:41 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:41 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.425s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e 1G Sep 03 13:52:41 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:41 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea" returned: 0 in 0.428s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 Sep 03 13:52:41 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:41 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e 1G" returned: 0 in 0.508s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:41 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:41 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966" returned: 0 in 0.448s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966 Sep 03 13:52:41 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:41 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:41 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e is being set with open permissions: ugo+rw Sep 03 13:52:41 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:41 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:41 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:42 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea.03a558c9-0bd5-456c-b7db-8562b4594966" returned: 0 in 0.298s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-03a558c9-0bd5-456c-b7db-8562b4594966" released by "_delete_snapshot" :: held 1.780s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" released by "delete_snapshot" :: held 1.813s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Created reservations ['db918de6-f276-4a6a-b264-601cf92af1e1', '7ef1ec13-5f54-4297-bdea-99969ea13ef9', '4e8745d3-d2dc-491d-852e-c10612e4664c', '9fd983f2-238f-4488-9c88-85fcd1626f19'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:42 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.294s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-fd6f27c7-2014-4aae-9d7b-8ec3ef41913f tempest-ProjectMemberTests-669573642 None] Lock "cinder-03a558c9-0bd5-456c-b7db-8562b4594966-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:42 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info Sep 03 13:52:42 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-bdbb1956-dbca-4af3-bfe6-a27777436dea-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-bdbb1956-dbca-4af3-bfe6-a27777436dea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" acquired by "delete_volume" :: waited 0.020s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:42 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info" returned: 0 in 0.300s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:42 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info is being set with open permissions: ugo+rw Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d731f9-9b1c-42fa-98ad-76b3b6fd760f]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:42 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info Sep 03 13:52:42 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:42 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea Sep 03 13:52:42 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:42 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.info" returned: 0 in 0.293s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:42 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:42 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-cdbbd920-59af-43c4-bdb4-4fd575996919 tempest-SnapshotDependencyTests-583116048 None] Create snapshot completed successfully Sep 03 13:52:43 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:43 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea Sep 03 13:52:43 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:43 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-bdbb1956-dbca-4af3-bfe6-a27777436dea" returned: 0 in 0.261s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-bdbb1956-dbca-4af3-bfe6-a27777436dea" released by "delete_volume" :: held 0.753s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Created reservations ['c5d70044-8cf4-472f-98f8-d2b9d43fc1fc', 'ac89348d-303f-460e-9dae-f1280f879e40', '59dad4a1-a99e-4c45-aae5-a7c9945588ae', 'c1f035c1-e4d7-4032-a694-b9a178e12d90'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:43 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:43 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:43 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.269s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:43 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:43 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-34ef5660-1d80-440f-be15-5cb0098d4bb4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-bdbb1956-dbca-4af3-bfe6-a27777436dea-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (3462cc29-42a1-464f-b83e-189dc4b3e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ddd87-0baa-4065-99f0-77a2213aa49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ddd87-0baa-4065-99f0-77a2213aa49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650051508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:44Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaad021-7069-4aba-8da2-5e9f7abaec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaad021-7069-4aba-8da2-5e9f7abaec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496a5753-fe8b-4c64-ac9a-74e8423e4361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496a5753-fe8b-4c64-ac9a-74e8423e4361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529', 'volume_name': 'volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6c8a95-cba2-4945-8386-8fe6b4974fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6c8a95-cba2-4945-8386-8fe6b4974fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6529b33d-50d4-4218-ac04-17d69bccdfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Volume b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529', 'volume_size': 1} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650051508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:44Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Creating volume b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:44 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:44 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 1073741824 Sep 03 13:52:44 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Flow 'volume_create_manager' (11d61f04-b00f-4f2e-985f-803100c62e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6449d5-edb7-48f3-8637-a048e5771781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6449d5-edb7-48f3-8637-a048e5771781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f164da-093e-4f62-92cb-02bb1a182b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f5e86a23f34671b518e544193c6b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98337e75-73ba-4c82-895b-7b0fbb39921e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:44Z,use_quota=True,user_id='e5725c1cee6140e9856e9de9523582a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566f628f-6620-44ec-b1ae-495f35cf6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566f628f-6620-44ec-b1ae-495f35cf6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a70396-dafc-4c40-8524-05ce85ca71ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a70396-dafc-4c40-8524-05ce85ca71ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94f164da-093e-4f62-92cb-02bb1a182b6b', 'volume_name': 'volume-94f164da-093e-4f62-92cb-02bb1a182b6b', 'volume_size': 1, 'snapshot_id': '98337e75-73ba-4c82-895b-7b0fbb39921e'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d742f39-00c9-4f58-bf61-45c053cfe069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d742f39-00c9-4f58-bf61-45c053cfe069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d5b9e7-f7e7-4c72-903a-601bc2af3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Volume 94f164da-093e-4f62-92cb-02bb1a182b6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94f164da-093e-4f62-92cb-02bb1a182b6b', 'volume_size': 1, 'snapshot_id': '98337e75-73ba-4c82-895b-7b0fbb39921e'} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:44 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 1073741824" returned: 0 in 0.438s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:44 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 Sep 03 13:52:44 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:44 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.401s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e-94f164da-093e-4f62-92cb-02bb1a182b6b" by "_create_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6529b33d-50d4-4218-ac04-17d69bccdfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c531ac5e-c16e-4f95-be56-75b9babf1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e-94f164da-093e-4f62-92cb-02bb1a182b6b" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Creating volume 94f164da-093e-4f62-92cb-02bb1a182b6b from snapshot 98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" by "_copy_volume_from_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:44 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Volume volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 (b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529): created successfully Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c531ac5e-c16e-4f95-be56-75b9babf1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:44 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (3462cc29-42a1-464f-b83e-189dc4b3e604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] snapshot: 98337e75-73ba-4c82-895b-7b0fbb39921e, volume: 94f164da-093e-4f62-92cb-02bb1a182b6b, {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 13:52:45 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-e04f7989-9403-436a-a3dc-74ceca0a93eb tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[361ae8ab-194a-460c-acb6-82bc287d3137]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:45 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:45 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:45 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.405s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633995b-acc9-42d2-b71d-33a3529b233c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:45 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:45 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:45 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.363s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Creating direct copy from snapshot {{(pid=86933) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG cinder.utils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Path /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b not found in is_blk_device check {{(pid=86933) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 13:52:45 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:45 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b Sep 03 13:52:45 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:50 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b" returned: 0 in 4.750s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Image conversion details: src /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b {{(pid=86933) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 13:52:50 devstack cinder-volume[86933]: INFO cinder.image.image_utils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Converted 1024.00 MB image at 215.52 MB/s Sep 03 13:52:50 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b is being set with open permissions: ugo+rw Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:50 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b Sep 03 13:52:50 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:50 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b" returned: 0 in 0.259s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" released by "_copy_volume_from_snapshot" :: held 5.886s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e-94f164da-093e-4f62-92cb-02bb1a182b6b" released by "_create_volume_from_snapshot" :: held 5.965s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.522s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 28434c01-e982-4207-8103-efb4b9a27e0b of volume b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d5b9e7-f7e7-4c72-903a-601bc2af3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f164da-093e-4f62-92cb-02bb1a182b6b', 'volume_size': 1, 'snapshot_id': '98337e75-73ba-4c82-895b-7b0fbb39921e'}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd2024-030c-4634-9807-40a5f5e2c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[211cc410-1a98-4e76-9343-d2014c0421fe]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:50 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:51 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Volume volume-94f164da-093e-4f62-92cb-02bb1a182b6b (94f164da-093e-4f62-92cb-02bb1a182b6b): created successfully Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd2024-030c-4634-9807-40a5f5e2c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Flow 'volume_create_manager' (11d61f04-b00f-4f2e-985f-803100c62e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:51 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-967fb37b-9e9a-4a64-afa8-0fd8eea1645d tempest-SnapshotDependencyTests-583116048 None] Created volume successfully. Sep 03 13:52:51 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 Sep 03 13:52:51 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-98337e75-73ba-4c82-895b-7b0fbb39921e-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-98337e75-73ba-4c82-895b-7b0fbb39921e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Deleting offline snapshot 98337e75-73ba-4c82-895b-7b0fbb39921e of volume 194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] snapshot_file for this snap is: volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9c970-a241-462c-8752-5afd75d00446]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:51 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" returned: 0 in 0.422s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:51 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b 1G Sep 03 13:52:51 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:51 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:51 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:51 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.420s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3d74c-37a2-4c3f-a744-308b1b2778ac]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:51 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b 1G" returned: 0 in 0.438s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:51 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:51 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b Sep 03 13:52:51 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:51 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:51 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:52 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b" returned: 0 in 0.331s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:52 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b is being set with open permissions: ugo+rw Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:52 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b Sep 03 13:52:52 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:52 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.582s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:52 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:52 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:52 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b" returned: 0 in 0.283s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:52 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info Sep 03 13:52:52 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:52 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:52 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info is being set with open permissions: ugo+rw Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.398s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:52 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:52 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info Sep 03 13:52:52 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:52 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e Sep 03 13:52:52 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:53 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd.98337e75-73ba-4c82-895b-7b0fbb39921e" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:53 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.info" returned: 0 in 0.303s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-98337e75-73ba-4c82-895b-7b0fbb39921e" released by "_delete_snapshot" :: held 1.789s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" released by "delete_snapshot" :: held 1.820s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f929a4d3-2e06-4bf8-b508-b5195a0acdc2 tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Created reservations ['68021f33-ef35-4ec4-b310-63b27bf2eb6e', 'a850eaae-4966-4de4-bf90-2b13e80698f2', 'bad14eba-6752-49a6-8d6d-47e3de5ae818', '82cf0dd7-23a9-4210-b73c-08a9807980d6'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:53 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Delete snapshot completed successfully. Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-294218f5-e6bf-4a10-a3bb-a7a53650fff9 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-98337e75-73ba-4c82-895b-7b0fbb39921e-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-194605d8-e2b6-4870-9cf0-39dcba37f8bd-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-194605d8-e2b6-4870-9cf0-39dcba37f8bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bbd55f-53a1-49e8-9eeb-ac4d88b7f18c]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:53 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:53 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-28434c01-e982-4207-8103-efb4b9a27e0b-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-28434c01-e982-4207-8103-efb4b9a27e0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-28434c01-e982-4207-8103-efb4b9a27e0b" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-28434c01-e982-4207-8103-efb4b9a27e0b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 28434c01-e982-4207-8103-efb4b9a27e0b of volume b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:52:53 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.432s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28413b4-6e4e-4ae9-be16-78d53848e5dd]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:53 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:54 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd Sep 03 13:52:54 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:54 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b Sep 03 13:52:54 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:54 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-194605d8-e2b6-4870-9cf0-39dcba37f8bd" returned: 0 in 0.299s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-194605d8-e2b6-4870-9cf0-39dcba37f8bd" released by "delete_volume" :: held 0.809s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Created reservations ['3aeddcf2-1ae8-43af-a154-1e33cfef360f', 'e1da4d33-d57d-4e34-8b8d-60c5bfbe6976', 'ff4b7c66-737f-4fa3-9286-8bd28c9374eb', '752ed469-e967-418e-9bec-f1257af5f54e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:54 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b" returned: 0 in 0.405s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced71790-2ee1-40a5-8c0b-2f402954e749]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:54 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:54 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:54 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 Sep 03 13:52:54 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-94f164da-093e-4f62-92cb-02bb1a182b6b-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-94f164da-093e-4f62-92cb-02bb1a182b6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:54 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:54 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Deleted volume successfully. Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" acquired by "delete_volume" :: waited 0.027s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-6bd3e246-5711-4daf-93a1-d1ea85d5b778 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-194605d8-e2b6-4870-9cf0-39dcba37f8bd-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b05455-6057-451d-9795-ea329b665c85]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:54 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b Sep 03 13:52:54 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:54 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:54 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:54 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b Sep 03 13:52:54 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:55 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b" returned: 0 in 0.366s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:55 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b Sep 03 13:52:55 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:55 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:55 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b Sep 03 13:52:55 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:55 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-94f164da-093e-4f62-92cb-02bb1a182b6b" returned: 0 in 0.271s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-quobyte-94f164da-093e-4f62-92cb-02bb1a182b6b" released by "delete_volume" :: held 0.690s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Created reservations ['95b673f7-8011-4e50-a1a2-a3815552d0ae', '31719a94-1678-4a98-98cd-0722ced362f6', 'f00874e7-9f0b-43d7-b6f9-bc5db774582f', 'cce4d8c6-d5a0-4b6d-a899-f48e5b1690cf'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:55 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529.28434c01-e982-4207-8103-efb4b9a27e0b" returned: 0 in 0.265s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-28434c01-e982-4207-8103-efb4b9a27e0b" released by "_delete_snapshot" :: held 1.597s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" released by "delete_snapshot" :: held 1.645s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:55 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:55 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Created reservations ['e67499ba-f8d3-463e-884a-59f3ec234f39', 'f4a25a06-d6db-4b84-ad53-3b42d5ed8ed1', '953ca725-f794-4d7d-9f18-a54414e274e8', '7c60bc47-33c9-4545-8056-4fab5341f246'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-907b7ba0-1047-41cb-91ef-ccf564d481d5 tempest-ProjectMemberTests-669573642 None] Lock "cinder-28434c01-e982-4207-8103-efb4b9a27e0b-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:55 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.274s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:55 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Deleted volume successfully. Sep 03 13:52:55 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-a41032b5-1832-40bb-aa91-4c1b7375fb99 tempest-SnapshotDependencyTests-583116048 None] Lock "cinder-94f164da-093e-4f62-92cb-02bb1a182b6b-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" acquired by "delete_volume" :: waited 0.018s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1a4d3b-768d-4276-9afa-175f9cfc336b]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:56 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 Sep 03 13:52:56 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:56 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" returned: 0 in 0.381s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:56 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529 Sep 03 13:52:56 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:56 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" returned: 0 in 0.265s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529" released by "delete_volume" :: held 0.728s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:56 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Created reservations ['56bda103-674a-4060-9444-1b5e57cce0d5', '386f10f9-bfcb-4c65-b23e-716b49e74a2e', 'a7df78db-06ac-449b-a9f7-43942c05346d', 'b32a5635-6dac-434c-a0cc-f264451a964e'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:57 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:52:57 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:57 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.290s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:52:57 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-91382cf0-5fac-4a0f-9fdc-e07da2364ed4 tempest-ProjectMemberTests-669573642 None] Lock "cinder-b9dbd2fa-24d5-4ee6-bc0b-d1ecedab4529-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (45637f6a-6ecb-4943-a18b-14afc9d67fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bba94f-908f-4896-b354-d84b6fe92336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bba94f-908f-4896-b354-d84b6fe92336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810223008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:58Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea66f6cf-c296-4dac-8cc9-561ce3bf4f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea66f6cf-c296-4dac-8cc9-561ce3bf4f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646eff7-f947-4bfd-aedc-6d051cb98837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646eff7-f947-4bfd-aedc-6d051cb98837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3', 'volume_name': 'volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b69734-eccf-4592-b547-4406ce9a4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b69734-eccf-4592-b547-4406ce9a4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dab22ef-2c33-48e3-b8b4-8f0ebdfc2732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:57 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Volume c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3', 'volume_size': 1} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810223008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:52:58Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Creating volume c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:52:57 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:52:57 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:57 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 1073741824 Sep 03 13:52:57 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:58 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 1073741824" returned: 0 in 0.510s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:52:58 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 Sep 03 13:52:58 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:52:58 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" returned: 0 in 0.275s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dab22ef-2c33-48e3-b8b4-8f0ebdfc2732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2538ea66-0d36-400d-aab0-be6db3391513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:52:58 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Volume volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 (c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3): created successfully Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2538ea66-0d36-400d-aab0-be6db3391513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:52:58 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (45637f6a-6ecb-4943-a18b-14afc9d67fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:52:58 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-efbc5a6a-6225-4620-98a9-de9615612252 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Creating offline snapshot e95d6978-9806-4f9a-ae43-9fd8d474109d of volume c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4263b55e-e4de-43f2-9c26-ad2925f86f99]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:00 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 Sep 03 13:53:00 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:00 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" returned: 0 in 0.442s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:00 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:00 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d 1G Sep 03 13:53:00 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:01 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d 1G" returned: 0 in 0.539s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:01 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d Sep 03 13:53:01 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:01 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d" returned: 0 in 0.348s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:01 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d is being set with open permissions: ugo+rw Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:01 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d Sep 03 13:53:01 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:01 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d" returned: 0 in 0.297s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:01 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:01 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info Sep 03 13:53:01 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:02 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info" returned: 0 in 0.287s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:02 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info is being set with open permissions: ugo+rw Sep 03 13:53:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:02 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info Sep 03 13:53:02 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:02 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.info" returned: 0 in 0.301s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:02 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:02 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-164d63cc-a75d-451f-884f-b23e578fee6a tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-e95d6978-9806-4f9a-ae43-9fd8d474109d-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-e95d6978-9806-4f9a-ae43-9fd8d474109d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-e95d6978-9806-4f9a-ae43-9fd8d474109d" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-e95d6978-9806-4f9a-ae43-9fd8d474109d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot e95d6978-9806-4f9a-ae43-9fd8d474109d of volume c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b294f32b-514d-46cb-975b-9e94596d99f6]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:03 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d Sep 03 13:53:03 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:03 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d" returned: 0 in 0.446s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a3c2c-0bc6-42c1-aa84-8430df269ebd]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:03 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:03 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 Sep 03 13:53:03 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:04 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" returned: 0 in 0.402s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:04 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d Sep 03 13:53:04 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:04 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d" returned: 0 in 0.601s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:04 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:04 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d Sep 03 13:53:04 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:05 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3.e95d6978-9806-4f9a-ae43-9fd8d474109d" returned: 0 in 0.344s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-e95d6978-9806-4f9a-ae43-9fd8d474109d" released by "_delete_snapshot" :: held 1.921s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" released by "delete_snapshot" :: held 1.956s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=175,cinder:UPDATE=221,cinder:INSERT=56,cinder:DELETE=21 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=176,cinder:UPDATE=237,cinder:INSERT=67,cinder:DELETE=17 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Created reservations ['3d5830e9-0da5-459e-9dff-147b65883884', '7e411a44-9df0-4ade-8ec2-008897221df7', 'feb2a1ab-17b0-4ef6-82c1-70fe1925f871', '5a3ce82e-27b4-4b88-9757-f7e3e99274f7'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:05 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:53:05 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-53e25cab-12a9-4271-a9d1-eea591b6753e tempest-ProjectMemberTests-669573642 None] Lock "cinder-e95d6978-9806-4f9a-ae43-9fd8d474109d-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "cinder-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" acquired by "delete_volume" :: waited 0.033s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a10d03d-2dad-4bb7-82e4-4f752be52776]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:06 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:06 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 Sep 03 13:53:06 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:07 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" returned: 0 in 0.400s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:07 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3 Sep 03 13:53:07 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:07 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" returned: 0 in 0.268s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3" released by "delete_volume" :: held 0.762s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Created reservations ['0bc4022c-5df8-43e5-9f66-a29e90e28a56', '1ca076f2-a0bf-4889-aef6-8244cbacbeb3', 'ad761e4e-3c94-437b-9824-b1190e190c3a', 'bc911868-b73f-40bb-b42f-1c13a82cb77f'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:07 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:07 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:07 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.306s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:07 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:53:07 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-3e28dd9f-5b98-4e12-88ae-28e1c65a2a08 tempest-ProjectMemberTests-669573642 None] Lock "cinder-c4e5ca07-3d8b-4b28-ab7d-61ac7b6e92f3-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (905b2843-3476-44e0-865e-527f05c866b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7412ca-d9eb-4466-a5d4-6132bf99a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7412ca-d9eb-4466-a5d4-6132bf99a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878547787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cfa08b-d606-4470-ba8a-8144ee83deaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:08Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a933f-8126-434a-a2e5-edd071cede06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a933f-8126-434a-a2e5-edd071cede06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44118c18-0b4d-48cf-b646-0f71b00dc66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44118c18-0b4d-48cf-b646-0f71b00dc66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75cfa08b-d606-4470-ba8a-8144ee83deaa', 'volume_name': 'volume-75cfa08b-d606-4470-ba8a-8144ee83deaa', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd490d8-487f-469a-8f1b-25ec4a21facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd490d8-487f-469a-8f1b-25ec4a21facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba701f-2486-4baf-8488-550f057e302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:08 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Volume 75cfa08b-d606-4470-ba8a-8144ee83deaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75cfa08b-d606-4470-ba8a-8144ee83deaa', 'volume_size': 1} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878547787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cfa08b-d606-4470-ba8a-8144ee83deaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4439ab15bff475fb13850b17d83323e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:08Z,use_quota=True,user_id='2cd7c879c2b14004bdf9366385fb37b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Creating volume 75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:53:08 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:08 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa 1073741824 Sep 03 13:53:08 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:08 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa 1073741824" returned: 0 in 0.434s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:08 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:08 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa Sep 03 13:53:08 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:09 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa" returned: 0 in 0.260s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba701f-2486-4baf-8488-550f057e302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75cfa08b-d606-4470-ba8a-8144ee83deaa', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaa243d-9434-4205-8f34-4c9cae1652c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:09 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Volume volume-75cfa08b-d606-4470-ba8a-8144ee83deaa (75cfa08b-d606-4470-ba8a-8144ee83deaa): created successfully Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaa243d-9434-4205-8f34-4c9cae1652c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Flow 'volume_create_manager' (905b2843-3476-44e0-865e-527f05c866b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:09 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b201df8a-e0a2-4c50-8bd0-58fd42cfcd87 tempest-ProjectMemberTests-669573642 None] Created volume successfully. Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Creating offline snapshot 4dcb9658-be2f-4e4c-bf40-ca748bcc220b of volume 75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87fc1e5-1277-4c20-866b-e9dd7ec68b1a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:09 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa Sep 03 13:53:09 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:09 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa" returned: 0 in 0.409s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:09 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b 1G {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:09 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b 1G Sep 03 13:53:09 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:10 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b 1G" returned: 0 in 0.431s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75cfa08b-d606-4470-ba8a-8144ee83deaa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:10 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75cfa08b-d606-4470-ba8a-8144ee83deaa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b Sep 03 13:53:10 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:10 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75cfa08b-d606-4470-ba8a-8144ee83deaa -F qcow2 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b" returned: 0 in 0.327s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:10 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b is being set with open permissions: ugo+rw Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:10 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b Sep 03 13:53:10 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:10 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:10 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:10 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info Sep 03 13:53:10 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:11 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info" returned: 0 in 0.263s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:11 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.remotefs [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info is being set with open permissions: ugo+rw Sep 03 13:53:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:11 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info Sep 03 13:53:11 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:11 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.info" returned: 0 in 0.266s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:11 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:11 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-2e95e0ef-b5b7-49b6-b190-1ce34828aacb tempest-ProjectMemberTests-669573642 None] Create snapshot completed successfully Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-4dcb9658-be2f-4e4c-bf40-ca748bcc220b-delete_snapshot" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-4dcb9658-be2f-4e4c-bf40-ca748bcc220b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" by "delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-4dcb9658-be2f-4e4c-bf40-ca748bcc220b" by "_delete_snapshot" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-4dcb9658-be2f-4e4c-bf40-ca748bcc220b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Deleting offline snapshot 4dcb9658-be2f-4e4c-bf40-ca748bcc220b of volume 75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] snapshot_file for this snap is: volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5306faa-d4cd-4a5a-b794-c9cffd2970e9]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:12 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:12 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b Sep 03 13:53:12 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:13 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b" returned: 0 in 0.360s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75cfa08b-d606-4470-ba8a-8144ee83deaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86933) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084ba3b-ac41-4bd3-9a8f-310cdf1f694a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:13 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa Sep 03 13:53:13 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:13 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa" returned: 0 in 0.351s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:13 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b Sep 03 13:53:13 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:13 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b" returned: 0 in 0.342s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:13 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:13 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b Sep 03 13:53:13 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:14 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa.4dcb9658-be2f-4e4c-bf40-ca748bcc220b" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-4dcb9658-be2f-4e4c-bf40-ca748bcc220b" released by "_delete_snapshot" :: held 1.383s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" released by "delete_snapshot" :: held 1.405s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Created reservations ['22c296f1-7d07-4b36-a4cd-741288b0afb1', '6cbf00c0-91a8-49f2-9f58-8b990b12d655', 'e66bd5a9-840a-4f35-a376-5c65801c6001', '58c27432-6e76-48f4-b1e3-1bec3a8c7f35'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:14 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Delete snapshot completed successfully. Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-69537cb2-c48b-4ed2-ae13-bc2622129986 tempest-ProjectMemberTests-669573642 None] Lock "cinder-4dcb9658-be2f-4e4c-bf40-ca748bcc220b-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-75cfa08b-d606-4470-ba8a-8144ee83deaa-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "cinder-75cfa08b-d606-4470-ba8a-8144ee83deaa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Acquiring lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703c2a9-868a-426b-a566-a319adab67cf]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:14 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:15 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa Sep 03 13:53:15 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:15 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa" returned: 0 in 0.361s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:15 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa Sep 03 13:53:15 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:15 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-75cfa08b-d606-4470-ba8a-8144ee83deaa" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "cinder-quobyte-75cfa08b-d606-4470-ba8a-8144ee83deaa" released by "delete_volume" :: held 0.658s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Created reservations ['18137dff-a2cb-4699-90d6-b39a22abc631', 'bab48675-aeef-48a0-b680-d1d6ddc17c0e', '84e18beb-cb12-4c97-8dba-15be3f66068a', '519f9cdf-9e44-46aa-8f2a-e3a8c8a8b3c5'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:15 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:15 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:15 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.240s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:15 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Deleted volume successfully. Sep 03 13:53:15 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-be4b9add-f871-4e9b-a09a-d0aba56396ec tempest-ProjectMemberTests-669573642 None] Lock "cinder-75cfa08b-d606-4470-ba8a-8144ee83deaa-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (c64dafe7-dd65-4952-9042-a7fab902a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee394b4-2a93-49c5-8e61-db73631e798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee394b4-2a93-49c5-8e61-db73631e798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705251151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f4f41-2e2a-4860-80a8-e2cc86abee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:23Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4996fd45-4706-463a-98e8-cac2854a3c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4996fd45-4706-463a-98e8-cac2854a3c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8940c859-c007-463a-a1f5-10d4832ed0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8940c859-c007-463a-a1f5-10d4832ed0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4f4f41-2e2a-4860-80a8-e2cc86abee50', 'volume_name': 'volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cba86e9-ed27-47d7-9cc7-ebd99150e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cba86e9-ed27-47d7-9cc7-ebd99150e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e18559b-0a03-40a8-8612-ab724efede3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:23 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Volume 7f4f4f41-2e2a-4860-80a8-e2cc86abee50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50', 'volume_size': 1} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705251151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f4f41-2e2a-4860-80a8-e2cc86abee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:23Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Creating volume 7f4f4f41-2e2a-4860-80a8-e2cc86abee50 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:53:23 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:23 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 1073741824 Sep 03 13:53:23 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:23 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:23 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 1073741824" returned: 0 in 0.415s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:24 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 Sep 03 13:53:24 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:24 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" returned: 0 in 0.241s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e18559b-0a03-40a8-8612-ab724efede3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b258b2-ef00-4d31-8d95-8c8429726d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:24 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Volume volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 (7f4f4f41-2e2a-4860-80a8-e2cc86abee50): created successfully Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b258b2-ef00-4d31-8d95-8c8429726d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (c64dafe7-dd65-4952-9042-a7fab902a568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:24 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d0f077f1-e958-49ba-8d76-97310d00b7a1 tempest-ProjectReaderTests-1810235297 None] Created volume successfully. Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-7f4f4f41-2e2a-4860-80a8-e2cc86abee50-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-7f4f4f41-2e2a-4860-80a8-e2cc86abee50-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-quobyte-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" acquired by "delete_volume" :: waited 0.015s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fabd5c-5576-4935-8bb3-4d2a9a0d2d3a]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:24 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:24 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 Sep 03 13:53:24 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:25 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" returned: 0 in 0.352s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:25 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50 Sep 03 13:53:25 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:25 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-7f4f4f41-2e2a-4860-80a8-e2cc86abee50" released by "delete_volume" :: held 0.637s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Created reservations ['3ae67a45-d2f7-4d9d-91cb-8341c077ff31', 'f7ced944-b792-4686-9781-81e9b9cbb8ca', 'f93079b8-1333-4ea5-9df9-a0567f5cda96', '762a5704-b2eb-4b8d-bdb9-326553ba1b92'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:25 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:25 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:25 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.250s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:25 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Deleted volume successfully. Sep 03 13:53:25 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-b70f1ea6-e356-46c6-a793-c1e590ed164f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-7f4f4f41-2e2a-4860-80a8-e2cc86abee50-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (2ae323b9-7d48-4c27-b896-c7a7e593645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9594e2f5-1848-464b-a04d-c5483c64ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9594e2f5-1848-464b-a04d-c5483c64ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907121451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b413d96-52d5-43bd-9549-c7fb671be170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:26Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df44fae6-9ba9-4972-b8dc-436e1b6d4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df44fae6-9ba9-4972-b8dc-436e1b6d4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18466ed2-8d37-4a11-8bca-80a3fd6dd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18466ed2-8d37-4a11-8bca-80a3fd6dd11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b413d96-52d5-43bd-9549-c7fb671be170', 'volume_name': 'volume-1b413d96-52d5-43bd-9549-c7fb671be170', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58bedd-c58a-4bbe-a9fd-c4769cf93370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58bedd-c58a-4bbe-a9fd-c4769cf93370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e7bd37-eee8-4cb6-964b-93775dd3e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:26 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Volume 1b413d96-52d5-43bd-9549-c7fb671be170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b413d96-52d5-43bd-9549-c7fb671be170', 'volume_size': 1} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907121451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b413d96-52d5-43bd-9549-c7fb671be170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:26Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Creating volume 1b413d96-52d5-43bd-9549-c7fb671be170 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:53:26 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:26 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 1073741824 Sep 03 13:53:26 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:26 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 1073741824" returned: 0 in 0.414s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:26 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 Sep 03 13:53:26 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:26 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170" returned: 0 in 0.242s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e7bd37-eee8-4cb6-964b-93775dd3e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b413d96-52d5-43bd-9549-c7fb671be170', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:26 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d11c96-9d09-4e8a-b1ae-eb5dab61e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:27 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Volume volume-1b413d96-52d5-43bd-9549-c7fb671be170 (1b413d96-52d5-43bd-9549-c7fb671be170): created successfully Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d11c96-9d09-4e8a-b1ae-eb5dab61e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (2ae323b9-7d48-4c27-b896-c7a7e593645a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-8b4800fc-3e17-42e4-8a9b-ed980b5d4aa5 tempest-ProjectReaderTests-1810235297 None] Created volume successfully. Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-1b413d96-52d5-43bd-9549-c7fb671be170-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-1b413d96-52d5-43bd-9549-c7fb671be170-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-quobyte-1b413d96-52d5-43bd-9549-c7fb671be170" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-1b413d96-52d5-43bd-9549-c7fb671be170" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab37af5-aca9-4845-ae49-c9d5f90fc494]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:27 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 Sep 03 13:53:27 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:27 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170" returned: 0 in 0.343s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:27 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170 Sep 03 13:53:27 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:27 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-1b413d96-52d5-43bd-9549-c7fb671be170" returned: 0 in 0.254s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:27 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-1b413d96-52d5-43bd-9549-c7fb671be170" released by "delete_volume" :: held 0.635s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Created reservations ['efd5a8fe-acf4-4215-98c6-05ab6eeabff8', '33be500f-1d9f-4cf8-9c4b-f72c63dc815f', '3928e4a9-560a-41e9-8951-e742c59a71e4', 'dec28acb-d774-4574-add6-5bb6e12c4d8d'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:28 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:28 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:28 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.246s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:28 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Deleted volume successfully. Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-adfce8c9-b4b5-4634-a546-6d4db873299f tempest-ProjectReaderTests-1810235297 None] Lock "cinder-1b413d96-52d5-43bd-9549-c7fb671be170-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (549b9357-e68d-4dbd-a3a6-bb8aa443b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4260213d-8354-4ae8-b8ea-55f381dffebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4260213d-8354-4ae8-b8ea-55f381dffebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939240442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84ece4c-c289-41a4-ba9c-02594c7b7851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:29Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb102b73-bba9-4322-864a-e218060700c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb102b73-bba9-4322-864a-e218060700c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4f3357-aadd-4eb4-ba57-ee25a3cd92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4f3357-aadd-4eb4-ba57-ee25a3cd92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84ece4c-c289-41a4-ba9c-02594c7b7851', 'volume_name': 'volume-a84ece4c-c289-41a4-ba9c-02594c7b7851', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb787243-1534-4613-b89a-47f48041d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb787243-1534-4613-b89a-47f48041d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be08b125-4e54-491e-943c-71005076ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:28 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Volume a84ece4c-c289-41a4-ba9c-02594c7b7851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84ece4c-c289-41a4-ba9c-02594c7b7851', 'volume_size': 1} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939240442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84ece4c-c289-41a4-ba9c-02594c7b7851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:29Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Creating volume a84ece4c-c289-41a4-ba9c-02594c7b7851 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:53:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:53:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:28 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 1073741824 Sep 03 13:53:28 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:29 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 1073741824" returned: 0 in 0.391s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:29 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 Sep 03 13:53:29 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:29 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851" returned: 0 in 0.247s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be08b125-4e54-491e-943c-71005076ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84ece4c-c289-41a4-ba9c-02594c7b7851', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885f2930-c9ac-47e8-acd0-8108732b02fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:29 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Volume volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 (a84ece4c-c289-41a4-ba9c-02594c7b7851): created successfully Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885f2930-c9ac-47e8-acd0-8108732b02fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (549b9357-e68d-4dbd-a3a6-bb8aa443b69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-19645e1a-f4d6-4239-ab36-d7a859b7c304 tempest-ProjectReaderTests-1810235297 None] Created volume successfully. Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-a84ece4c-c289-41a4-ba9c-02594c7b7851-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "cinder-a84ece4c-c289-41a4-ba9c-02594c7b7851-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-quobyte-a84ece4c-c289-41a4-ba9c-02594c7b7851" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:29 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-a84ece4c-c289-41a4-ba9c-02594c7b7851" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[476182de-9d57-454c-a51c-6f2daa09b3ad]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:30 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 Sep 03 13:53:30 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:30 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851" returned: 0 in 0.358s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:30 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851 Sep 03 13:53:30 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:30 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-a84ece4c-c289-41a4-ba9c-02594c7b7851" returned: 0 in 0.243s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-a84ece4c-c289-41a4-ba9c-02594c7b7851" released by "delete_volume" :: held 0.640s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Created reservations ['4491ffaf-5c5f-48ea-9a52-86e7ab29524a', 'a579d44f-26b8-4703-b9ce-67c34b3814af', '4fa66293-9b1d-4ffd-b4dd-6bf86c9abbbf', 'facacce5-51c6-4633-8167-f37e6dadc17a'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:30 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:30 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:30 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.253s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:30 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:30 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Deleted volume successfully. Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-f9ab8749-7a5d-4f09-a87f-fa0080188e3a tempest-ProjectReaderTests-1810235297 None] Lock "cinder-a84ece4c-c289-41a4-ba9c-02594c7b7851-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.flows.manager.create_volume [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86933) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (c02afbc3-193d-473a-b770-d984a94e4713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a51427d-d440-4580-a025-44182ade236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a51427d-d440-4580-a025-44182ade236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155201043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879493be-b904-4ea9-ad5e-6bcb0315b870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:31Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61142f75-8a5e-4401-8df5-20c1b309aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61142f75-8a5e-4401-8df5-20c1b309aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9993949-b31c-4aa8-bb4e-5ad0aff18fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9993949-b31c-4aa8-bb4e-5ad0aff18fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879493be-b904-4ea9-ad5e-6bcb0315b870', 'volume_name': 'volume-879493be-b904-4ea9-ad5e-6bcb0315b870', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c2a581-26b8-493f-8970-517c333aa40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c2a581-26b8-493f-8970-517c333aa40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a938922c-0fa2-49fe-94fe-82a9e32c676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:31 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Volume 879493be-b904-4ea9-ad5e-6bcb0315b870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879493be-b904-4ea9-ad5e-6bcb0315b870', 'volume_size': 1} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155201043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879493be-b904-4ea9-ad5e-6bcb0315b870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758c1d192a94ccd815b6c288bfbdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T11:53:31Z,use_quota=True,user_id='4a9588f6f3904a69bc82643b67fa73e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fa3d0d-4b2f-49f7-aab1-be34babd4f1d),volume_type_id=10fa3d0d-4b2f-49f7-aab1-be34babd4f1d)}" {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Creating volume 879493be-b904-4ea9-ad5e-6bcb0315b870 {{(pid=86933) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Selected osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c as target Quobyte volume. {{(pid=86933) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 13:53:31 devstack cinder-volume[86933]: INFO cinder.volume.drivers.remotefs [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] casted to osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 1073741824 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:31 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 1073741824 Sep 03 13:53:31 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:31 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 1073741824" returned: 0 in 0.395s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:31 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:32 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 Sep 03 13:53:32 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:32 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870" returned: 0 in 0.243s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'} {{(pid=86933) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a938922c-0fa2-49fe-94fe-82a9e32c676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879493be-b904-4ea9-ad5e-6bcb0315b870', 'volume_size': 1}' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33ca63-0028-4c08-b0ff-a6eda9fe11ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 13:53:32 devstack cinder-volume[86933]: INFO cinder.volume.flows.manager.create_volume [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Volume volume-879493be-b904-4ea9-ad5e-6bcb0315b870 (879493be-b904-4ea9-ad5e-6bcb0315b870): created successfully Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33ca63-0028-4c08-b0ff-a6eda9fe11ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86933) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Flow 'volume_create_manager' (c02afbc3-193d-473a-b770-d984a94e4713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86933) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 13:53:32 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-46713f3c-b69c-4780-b6fa-20af878a4600 tempest-ProjectReaderTests-1810235297 None] Created volume successfully. Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-879493be-b904-4ea9-ad5e-6bcb0315b870-delete_volume" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "cinder-879493be-b904-4ea9-ad5e-6bcb0315b870-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "cinder-quobyte-879493be-b904-4ea9-ad5e-6bcb0315b870" by "delete_volume" {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-879493be-b904-4ea9-ad5e-6bcb0315b870" acquired by "delete_volume" :: waited 0.016s {{(pid=86933) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1e373-bd3e-411e-b9c4-0f99702d01db]: (4, 'qcow2') {{(pid=88696) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:32 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 Sep 03 13:53:32 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:32 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870" returned: 0 in 0.367s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:32 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:33 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870 Sep 03 13:53:33 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:33 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e/volume-879493be-b904-4ea9-ad5e-6bcb0315b870" returned: 0 in 0.245s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "cinder-quobyte-879493be-b904-4ea9-ad5e-6bcb0315b870" released by "delete_volume" :: held 0.651s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.quota [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Created reservations ['9eeb5031-6734-4b98-bf93-1a8d63214b4e', 'fe71c86e-5631-4bc2-b030-2d98aa24c8c8', 'a05411b6-7a8c-480f-bdbb-e8cfe5754052', '7ea48536-fb4a-4dcf-b56d-dedf51470074'] {{(pid=86933) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:33 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:33 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:33 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.244s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:33 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Deleted volume successfully. Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.coordination [None req-17804c19-4008-4397-a36f-f8bc5b24a8c0 tempest-ProjectReaderTests-1810235297 None] Lock "cinder-879493be-b904-4ea9-ad5e-6bcb0315b870-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86933) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05be1bfb-bc27-493e-b540-4d8bc24b525c'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 13:53:33 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e Sep 03 13:53:33 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 13:53:33 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4cff9b8c487495a48feecd122e515a1e" returned: 0 in 0.251s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread count: 28 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 13:53:33 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-1cbca762-5394-4037-9657-f9d36e7d8e7d None None] thread info: [<_MainThread(MainThread, started 140243912605824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 13:53:43 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=45,cinder:INSERT=20,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 13:53:43 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}